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Preface to the first edition 


n of my previous books Group Theory 1 and Ring Theory and 
Students are probably about to begin their second exposure to ie 
Algebra. Unlike their first brush with the subject, which A y 
emphasized Groups, Subgroups, Cyclic Groups, Normal subgroups, Isomorphisms, ector 

: 4 Basis, Matrices etc. we will focus on Automorphisms, Product of Groups, Inner 
Haier Spaces, Linear Maps, Operators, Canonical forms etc. These terms will be defined 
later, so don't worry if you don't know what they mean. The main goal of this book is to make 
those concepts palatable. The key point is that students are about to immerse themselves in 
serious mathematics, with an emphasis on their attaining a deep understanding of the 


definitions, theorems and proofs. 


This book is a continuatio 


Linear Algebra. 
Theory and Linear 
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Many thanks are due also to Mr Bimal kumar Dhur, Prof. Subhankar Dhur and Mr Dipankar 
Dhur of Academic Publishers for their continuous help and cooperation in this endeavour. 


Lastly, I would like to thank Mrs Susmita (Sumon) Bhattacharya, my wife, without whose 
constant support this work would never been possible. 


I would greatly appreciate hearing about any errors in this book, even minor ones. I welcome - 


your suggestions for improvements, even tiny ones. Please feel free to contact me by email 
at ranenpersonal@gmail.com 


Have fun ! 
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Unit-1 
Group Theory 


1.1 -AUTOMORPHISM 
1) 
It is presumed that students are already aware of groups and group 


isomorphism. But for recapitulation we wish to offer following definitions. 


Definition: Let(G, 0), (G'*)be two groups. A mappingf:G > G’is called a 
homomorphism if f (aob) = f (a) + f(b) Va,b EG. 

Definition: Let (G, 0), (G',*)be two groups. A homomorphism: G > G’is 

(a) Epimorphismif f is onto i.e. f(G) = G’ , 

(b) Monomorphismif f is injective. 

(c) Isomorphism if f is bijective. 

Example:(Z, +)is isomor rphic to(2Z, +). 

Define f:Z > 2Z by f (n) = 2n forn € Z. 

Let f(n) = f (m). Then 2n = 2m i.e.n =m. So f is injective. 

If y € 2Z theny = 2k, k €E Z. Hencef (k) = 2k = y. So f is onto. 

Form,n E Z, f(m +n) = 2(m +n) = 2m + 2n = f(m) + f(n). So fisa 
homomorphism. Hence f is an isomorphism. i 

It is clear from above that a mappingf : G > G’, whereGandG’are groups, is an 
isomorphism if 

(i) f (ab) = f(@) Ff) 

(ii) f is one — one 

(iii) (GQ) = G' 

Here operations are taken as multiplication. But what happens if we 
takeG’ =G, that is, what happens if we consider an isomorphism from a 
groupGonto itself ? 

Definition. An isomorphism from a group G onto itself is called an automorphism 
of G. eee ee 


(i) For any groupG, the identity mappingi:G—2G by i()=xis an 
automorphism ofG. 

(ii) Let R*be the set of all positive reals. Then we know thatRt forms a group 
with respect to multiplication. Definef : Rt > R* by f(x) = <. 


: 1 
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Forx,y E R+, we have,f (xy) = (xy)? = x*y? = f(x)f(y). Therefore, f is 
a homomorphism. 


Again, f (x) = f(y) => x? = y? => x = yasx > 0,y > 0.So,fis injective, 
2 
Fory € Rt, we have,,/y E Rtandf(,/y) = (Jy) = y. Therefore,fis onto. 


Hence, fis an automorphism. 


(iii) We know that(C, +), Cbeing the set of all complex numbers, is a group. 


(iv) 


[riet G be a group and leta E G. 


Definef : C > Cbyf (z) = Z, that is,f (a + ib) = a — ibwhere a,b are reals. 
Then for anyzı, Z2 E C, 

fitz) =7 422 =% +2 = fz) +f) 
Letz, w E Cwherez = a + ib,w =c + id, a, b,c,d € R. Now, 

f(z) = fw) => Z= W => a -ib =c- id=>a=c,b=d 

Thus, f(z) = f (w)impliesz = w, that is, fis injective. 
Letz € C. Thenz € Candf (Z) = Z = z. Thusfis onto. 
Hence, fis an automorphism ofC. 


IfC*denotes the set of non-zero complex numbers then we know 


thatC*forms a group with respect to multiplication. In the same way, it is 
easy to show thatf : C > C*defined byf (z) = Zis an automorphism ofC’. 


if we takeG = R? = {(a,b): a,b ER}. Then(G,+) is a group if ’+is 


defined as 
(a,b) + (c,d) = (a+c,b+d) 


Let us definef : G > Gbyf (a, b) = (b,a). Then, 
f((ab) + (c,d)) = f(a + cb +d))=(b+d,a+c) 
= (b,a) + (d,c) = f (a,b) + f(c,d) 


So, fis a homomorphism. Now, ` 
f(a,b) = f (c,d) => (b,a) = (d,c) =>b=d,a 


Therefore, f is injective. 
For (a,b) € G, there exists (b,a) € G such that f(b,a) 


= c => (a,b) = (c,d) 


= (a,b). Thus f is 


onto. 
Hence, f isan automorphism. 


-1 
Define a functionga : G > Goyga(x) = are 
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Now for x,y € G, we have, 
(xy) = axya™ = axataya™* = $a(*) ba) 


So, a is a homomorphism. 
a(x) = ba(y) => axa = aya-! => x = y (by cancellation laws in G) 

Therefore, dg is one-one. 

For y €G,wehave, aya E€ Gand ġa (atya) = a(a~tya)a* = y. 
Thus, d is onto. 

Hence, ¢, is an automorphism. This dq is of special interest as clear from the 
following definition. 
Definition. 


Let G be a group and let a€G. The functioné, : G > G defined by 
da (x) = axa”! for all x € G is called the inner automorphism corresponding to 


“a or the inner automorphism of G induced by a. 


Let G be a group. Let I be the identity mapping of G, that is, I(x) =x, Vx E 


G. 
Then 7 is an automorphism of G. Let A(G) or Aut(G) be the set of all 


automorphisms of G, that is, 
Aut(G) = A(G). ={f:G-G|f is an automorphism of G} 

Clearly, A(G) is a subset of S(G), the set of all permutations of G. Define 
product in A(G) as the compositions of mappings, that is, for f,g € A(G), 
(gN) = f(g(x))vx EG which is defined in S(G). We want to show that 
A(G) is a subgroup of S(G). 

Since, f,g E€ A(G), we have, f(xy) = fx) f(y) and gly) = g(x) 90) for 
all x,y E G and f, g are bijective. Since, composition of two bijective mappings is 
bijective, we have, fg is bijective. 

For x,y E G, and for f,g € Aut(G), using homomorphism properties of f and 
g, we have, 

f(xy) = F(9(zy)) = F(9@)90)) = F(9@))F(90)) = fo F90) 


Thus, fg isa homomorphism and hence is an automorphism of G. 

Therefore, f,g E A(G) => fg E€ A(G). 

Now, it is enough to show thatf € A(G) => f-! € A(G). Since, f is 
bijective, f—1 exists and f—? is also bijective. 

Let x,y E G. Then 


FF DTO) = FFT CO)F(F70)) = CY) = x 
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m 
if ($(a)) = e for some integer m with 0 < m < n, then we have 
$la™) =e = g(e) 
Since, @ is one-one, we have, a™ =e, which contradicts that o(a)=n 


as0 <m<n. 


Therefore, CICD + e for any integer m withO < m < n. 
Hence, o(¢(a)) =n = o(a). 


1.2 AUTOMORPHISM GROUPS OF FINITE AND INFINITE CYCLIC GROUPS 


Let G be a finite cyclic group of order r, that is, let G = < a > where a’ =e. 
Suppose T is an automorphism of G. Let g E€ G. Then g = aX for some k € Z. 
Thus, 


T@) =T(a*) = (T(a))‘[ as T is automorphism] 

Hence, T(g) is completely determined for any g E G, if T (a) is known. 

Now it is shown in theorem 1.1.2 that o(T(a)) = o(a) =r. 

Since, T(a) E€ G and G =< a >, we have, 

T(a) = af for some t withO < t <r. 

So, o(T(a)) = o(a) => o(a‘) =r, which shows that gcd(t,r) = 1. 

Hence, for each automorphism T of G, we get an integer t which is less than r 
and prime to r. Thus, Aut(G), the group automorphism of G, is in one-to-one 
correspondence with the group U, of integers less than r and relatively prime to r 
under multiplication modulo r. l 

Let us rename the elements of Aut(G) as T; where T; (a) = af forO <i<r 
and gcd(i,r) = 1. 

Now, 7;7;(a) =7;(a/) =a = Ty (a). Therefore, Tj = Tij- 

Define ġ : U, > Aut(G) by (i) = T;. Then 

pij) =Ty =T; = 0b) 

So, @ is a homorphism. It is shown that ¢ is bijective. Hence @ is an 
isomorphism. 

Hence, Aut(G) = U,- 

What happens if G is an infinite cyclic group? 

Let G = {a" : k © Z} be an infinite cyclic group generated by a. 

if and only if k = 0. 
Let T be an automorphism of G. Then T(a) € G =< a >. 50 there exists 
such that T(a) = a’. 


k= 
Here, 4 =e 


rez 


Group Theory 7 


since T is an automorphism of G, we have, T(G) =G. So, there exists g E€ G 


auch that Tg) = 4 
in, g € G implies that there exists i € Z such that g = a' 
i i P i 
mus a = T9) = T (ai) = (T@)' = @)! = a" 
which shows that a"~* = e, that is, ti — 1 = Ge that iti 1. 
t and i both are integers, we have, two possibilities : either t = 1,i = 1 


Aga 


Since, 
ort = —1,i = —1. ’ 
ift = 1, we have, T(a) =a. IfxE€ G then x = a” for some k E Z. Thus, we 


have, 
T(x) =T(a*) = (T(a))“ =a% =x 
That is, T(x) = x for all x € G which shows that T is identity automorphism. 
ift =—1,we have, T(a) = a™*. Thus, for x € G, we have, 
T(x) =T(a*) = (T(a))* =(e"}' = (ak) =a 

Thatis, T(x) = x7! forall x E G. 

Hence, if G is an infinite cyclic group, then there are only two automorphisms 
of G, one is identity automorphism and other takes g > g™ for all g EG, in 
other words, Aut (G) is isomorphic to a cyclic group of order 2. 


Solved Problems : 


1. Let G be a group, H a subgroup of G, T an automorphism of G. 
LetT(H) = {T (h) : h € H}. Prove that T(H) is a subgroup of G. 


Solution. By the problem, T : G > G isa homomorphism and bijective. 
Now, e E€ H => T (e) € T(H) => T(H) + Ø. 
Let ky,k> €T(H). Then there exist hy,h2€H such that T(hy) = ki, 
T(h2) = kz. Now, 
kykz} = T(hy)T(hz)-! = T(h Ths) =T hz1)[ as T is homomorphism] 
Since, H is a subgroup of G, we have, hı hz E H => hyhz* € H. Thus, 
T(Ayhz*) € T(H). 
Therefore, kıkz! = T (hhz!) € T(H). 
Hence, T(H) is a subgroup of G. 
2. Let G be a group. Prove that the mapping f(g) = g~! for all g € Gis an 
automorphism if and only if G is abelian. 


Solution. We first suppose that f :G >G given by f(g) =g™ is an 
automorphism. 
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Let a,b E G. Then f(a) = a™t, f(b) = b71. 
Again, f(ab) = F@f(b) 
a -1 — ,-1p,- 2 
=> (ab)~* = a™1b™! = (ba)™! => ab = ba 
Therefore, G is abelian. 
Conversely, let G be abelian. Leta, b € G. Then ab = ba. Now 
f (ab) = (ab)™ = (ba)~* = ab = F(a) f(b) 
So, f is a homomorphism. 
Let g,h € G such that f(g) = f (h), i.e, g7! =h}, ie, g =h. 
So, f is injective. 
F ists g7! a 
ae any g € G, there exists g™ € G such that f(g~") = (g71)-1 = g. So, f is 
Hence, f isan automorphism of G. 
3. Let G be a group, T an automorphism of G, N a normal subgroup of G. 
Prove that T(N) is a normal subgroup of G. 
Solution. . By the problem, T : G > G is a homomorphism and bijective. 
Now, e E N => T(e) € T(N) => T(N) + @. 
Let k,,k2 E T(N). Then there exist hy,hy E N such that T(hy) = kı, 
T(h2) = k2. Now, 
kiıkz7! = T(h)T Gy) * = T(h,)T(h3!) = T(hyhz}[ as T is homomorphism] 
Since, N is a subgroup of G, we have, hi, h E N => hyhz* E N. Thus, 
T(hyhz*) E€ T(N). 
Therefore, kık7! = T(hyhz) € T(N). 
Hence, T(N) is a subgroup of G. 
Let g' EG and k E T(N). AsT :G > G is onto, there exists g € G such that 
T(g) =g". 
Again, k € T(N) implies that there exists h € N such that T(h) = k. Thus, 


g' kg’ =T@)TAY(T(g)) = TTT) = T(ghg™') 


Since N is a normal subgroup of G, we have, g €G,h EN => ghg™ EN. 


Hence, 
g'kg™ = T(ghg™) ETN) 
Therefore, T(N) is a normal subgroup of G. 
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= pa ts 
Let G be a group of order 4, G = {e,a,b, ab}, a2 = b? = e, ab = ba. 


Determine Aut(G). 


Solution. By the problem, we see that orde 
(ab)? = abab = a?b?(as ab = ba) =e 
a = b7! = b whichis not the case. Thus, order of ab is 2. 


4. 


rofaand b are 2. Now, 


and ab + e otherwise, 
proper subgroups of G are given by {e, a}, {e, b}, fe, ab}. 


It is clear that 
order of T(a) is 2 as 


If T is an automorphism of G, then T(e) =e. Again, 
order of a is 2. So, there are three possibilities of T(a), viz. a, b, ab. 

Since, T is a homomorphism, we have T(a)T(b) = T(ab). 

if b + e, we have, the order of T(b) is 2 as the order of b is 2. So, again there 
are three possibilities of T(b) viz. a,b, ab. But one of these three members is 
already associated with T (a). So, two possibilities remain only. 


Hence, there are only 3 x 2 = 6 automorphisms of G. Thus Aut(G) is given by 


Q 


b b ab 

Aut(G) = & A i N b a a a 
e a b ee y a b A (e a bab 
e ab b a?/’\e b ab b/'\e a bab 


5. Let G be a finite group, T an automorphism of G with the property that 
T(x) = x for x € G if and only if x = e. Prove that every g € G can be 
represented as g = x7!T(x) for some x E G. 


Solution. Let us define a map f : G > G by f(x) = xTIT(x). Now, 
f(a) = f(b) => a™T (a) = b“T(b) 
=> T(a)(T(b)) = ab“ 
=> T(ab~) = ab 
It is given that, T(x) = x iff x = e for allx € G. Hence, T(ab-!) = ab! => 
ab =ele.a=b. 
Thus, f(a) = f(b) => a =b which proves that f is injective. Since, G is 
finite, f is onto. 
Therefore, for g € G, there exists x € G such that f(x) = g i.e. xT (x) = g. 
6. Let G be a finite group and T an automorphism of G with the property 


that T(x) = x if and only if x = e. Suppose further that T? = I. Show 
that, G is abelian. ‘ 


Solution. Let us define a map f : G > G by f(x) = xT (x). 


2 
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Now, f(a) = f(b) => a™tT(a) = bT (b) 
=> T(a)(T(b)) = ab“! => T(ab-1) = ap-1 


It is given that, T(x) = x iff x =e forallx E€ G. Hence T(ab-) 
, = ab7! = 


-1 — . nT 
ab~* =ei.e.a=b. > 


Thus, f(a) = f(b) => a = b which 
= i A T 
finite, f is onto. proves that f is injective, Since, G js 


Therefore, for g E G, there exist 
ie sx € G such that f(x) = g i.e. xT (x) =g. 


Tg) =T(xT@)) = TY TT) = (T) x (as T? = 1) 


= (TE) = g 
Thus, T(g) =g! Vg EG. So, fora,b EG, 
T(ab) = (ab)7} 
Again, T(ab) = T(a)T(b) = a“! b-! = (ba)7} 
Hence, (ab)“! = (ba)“!, i.e. ab = ba. 
Therefore, G is abelian. 


7. Showthat Aut (Z,) = Un. 
Solution. Since Z, is a cyclic group of order n, the result follows from article 1.2. 
8. Find two groups G and H such that G and H are not isomorphic but 
Aut(G) ~ Aut(H). 
S — 
olution. Let G = (Z2, +), H = ({0}, +). Clearly, G and H are not isomorphic. 
There is only one automorphism of G given by f(1) = 1. 
Thus, Aut(G) ~ Aut(H). 
9. If is i i 
pet a G is isomorphic to H, prove that Aut(G) is isomorphic to 
Solution. Let G and H be two groups and @ : G > H be an isomorphism. 
We define, p : Aut(G) > Aut(H) by B(f) = of o7. 
We first show that, B(f + g) = BC) + B(g). 


_ Let beH. Then $f6—1(b) = f(a) [ where (a) = b,a € G]. Similarly, 
pgp™ = pg (a) 
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bf + gb H) = OF + 9)(@) = (f(a) + g(a) = $f (a) + pg la) 
= ofp *(b) + pgp '(b) 


Hence,o(f + g)¢-! = PSH + pIo, 
ie. BU +9) = BA + BC) 

So, B is a homomorphism. 

Let f, g E Aut(G) such that BCf) = B(g), that is pfp = pgp! 

Let x E G. Then p(x) = y E H and p(y) =xas@isan isomorphism. 
Now, pfp) = ¢9b O) => bf (x) = pgx) 

Therefore, f(x) = g(x), Vx E G, as œ is one-one. Thus, f =g. 
Hence, f is injective. 
Let h € Aut(H). Then php E Aut(G). Now, 

B(d— hd) = php) =h 

Therefore, $ is onto. 
Hence, f is an isomorphism, in other words, Aut(G) = Aut(H). 


10. Let G be a group and Z the center of G. If T is any automorphism of G, 


prove that T(Z) c Z. 
Solution. By the problem, Z = {x €G:xg = gx,Yg E G} 
Let z €T(Z). Then there exists Z € Z such that T(z) = Z’. 


Therefore, zg = gz forall g E G. 
So, T(zg) = T(gz), i.e. T(z)T(g) = T(g)T (z) i.e. z T(g) = T(g)z’ for 
allg EG. 
Since, T :G > G is onto, every element g’ of G can be written as T(g) for 
some g € G. Thus, 
zg =g7, vg EG 
So, z' €Z. Hence, T(Z) cZ. 

11. Let G be a group and let g E G. If z € Z(G), Z(G) being the centre of G, 
show that the inner automorphism induced by g is the same as the inner 
automorphism induced by zg (that is, that the mappings Pg and dz, are 
equal). 

Solution. Let x € G. Thenġg (x) = gxg™* . Now, 


deg (x) = 2gx(zg)"! = zgxg™tz7" 


= (gxg~!)zz[ as z € Z(G)and gxg™ € G] 
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Le. zy (x) = gxg7 = dg (x), Vx EG and dom $y = dom py, =G 
Hence, bg = bz, m i 
12. If g and h are el t 
a ements from a group, prove that ghn = dyn. 
a ution. Let G be a group and fora € G, let abe the inner automorphism 
induced by a. Then for g,h € G, we have, Pg (x) = gxg™!, n(x) = hxh and 
Pgn (x) = ghx(gh)— for allx € G. on 
Let x E G. Then 
Pg hn Cx) = bg (hxh) = g(hxh-!)g-1 = (gh)x(gh)} = hyp, (x) 
Hence, PgPr = Pgh j 
13. Let G be a group and T an automorphism of G. If, for a E€ G,N(a) = 
{x € G : xa = ax}, prove that N(T(a)) = T(N(a)). 
Solution. Here N(T(a)) = {g €G : g'T(a) = T(a)g'}. 
Since T : G > G is onto there exists g € G such thatT (g) = g'. Thus, 
N(T(a)) = {T(9) : g € G and T(g)T(a) = T(a)T(g)} 
= {T (g) : g € G and T(ga) = T(ag)} 
= {T(g) : g E G and ga = ag} (as T is one — one) 
= {T(g) : g E G and g € N(a)} =T(N(a)) 
Hence, N(T(a)) = T(N(a)). 


Exercise 


Let G be a group. 

1. Show that all automorphisms of G form a group under function 
composition. l 

2. Let be an automorphism of a group G. Prove that H = {x E€ G : d(x) = 

_ x}is a subgroup of G. 

3. Ifø € Aut (G), and Pg is a conjugation by g, then prove that opga”! = 
Pog) 

4. If G is an abelian group, then prove that the map f:G—G by 
f(g) = g7 is an automorphism. 

5. Show that there are only two automorphisms of the group Ze. 

6. Show that o (Aut Zp) = p — 1 where p is prime. 

7.. How many automorphisms has a cyclic group of order ? of order pq ? 
(p,q distinct primes). 
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8. Show that Aut (2) = Z2. 


9, Prove that/nn(S3) = S3 = Aut (S3). 
_ If G be a cyclic group of order n and p be the Euler d-function. Prove that 


o(AutG) = p(n). 
11: Show that Inn (G) is a normal subgroup of Aut (G). 
12. Exhibit an automorphism of Zg that is not an inner automorphism. 
. Prove that an element g of a group G induces the inner automorphism 


identity if and only if it is in the centre. 
1.3 EXTERNAL DIRECT PRODUCT 
Suppose two groups are given. Can we form a larger group with the help of 
given groups? Let’s try. 
Let (G, 0) and (H,*) be two groups. We consider the product 
GxH={({@,A) ig € 6,1 Hy}. 
Let us define an operation’ .’ on G X H by 
(91,h1).(g2h2) = (g10g2, hi * h2) 
Clearly,’. ‘is closed as 91,92 E G => g1092 E G and h4, hz E H => hy + hz EH. 
Thus 
(g1, h1). (g2, h2) E G X H => (g1092, hı * h2) EG X H 
Let (gi hi), (g2,h2), (93, h3) EG XH. Then 
[Cgi h1). (g2,h2)]. (g3, h3) = (91092, h1 * h2) . (g3, h3) 
= (91092093, hı * hz * h3) 
and (g1, h1). [C92 h2). (g3, h3)] = (g1, h1). (92093, h2 * h3) 
= (91092093, h; * hz * h3) 
Hence, 
[Cgi h1). (92, h2)]. (93, h3) = (g1, h1). [C92 h2). (g3,h3)] 
which shows that '.' is associative. 
Clearly, (ecen) € GXH where eg and ey are the identities of G and H 
respectively. Then l 
h). (eg, = y= = 
(g, h). (eg, en) = (goeg,h * ey) = (g,h) = (ec0g, en * h) = (eg, ey).(g,h) 
So, (eç, €y) acts as an identity element in G x H. 
Let(g,h) EG XH. 
Now, g E G => g! € Gandh E H =>h €H. 
Therefore, (g7!, ht) E€ G x H. 
So, (gn) EG xH. 
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Then (g,h).(g71,h7) = (gog71,h *h71) = (eç,ep) 
and (g~*,h-*). (g, h) = (g710g,h7} * h) = (eg, ey) 


Thus inverse of (g, h) is (g~!, h7!) and it belongs to G x H. 

Hence, (G xH, .) is a group, known as external direct product of G and H 

For our convenience, let us drop the notations o,* and ., instead We use 
multiplication notation i.e. ony 

For the groups G and H, we define, the grou 

, , p G XH where th ion i 
Eat e operation is 
(g1, h1)(92, h2) = (9192, hhz) 
as external direct product of G and H. 

We can extent this concept to a finite number of groups, that is, if Gy, G3, ...G 
are groups then we can make G4 X G2 X ...X Gn into a group by means of a binar 
operation of multiplication by components. In other words if 
(a1, a2, ., Ari), (by, bz, ..., bn) E Gy X G3 X ... X Gand we define 

(ay, 12) cons a3) (by, bo, Hay b3) = (aib, azb, stay An Dn) 

Then G1 X G2 X ... X Gn is a group. 


1.3.1 Example. 

(a) Let us consider the group (Z x Z, +) where ‘+’ is defined component 
wise, that is, if a = (x,,y,;) E Z X Zand b = (x2,y2) EZXZ then 
atb=(x1+%2, Yı + y2). It is easy to verify that (Z x Z, +) is a group 
with (0,0) as identity element. 

(b) If we consider Z, the additive group of integers, and C*, the multiplicative 
group of all non-zero complex numbers, then G = Z x C* forms a group 
with respect to the binary composition defined as x = (m,,21),y = 
(mz, 22) € G implies xy = (m, + mz, 2122) where (0,1) acts as the identity 
element of G and inverse of (n, Z) E G will be (—n, 27"). 


(c) Consider the groups (Zz, +) and (Z3,+). Then Zz X Z3 forms an additive 


group where addition is defined component wise. Here, 


Z2 x Z3 = {(0,0), (0,1), (0,2), (1,0), (1,1), (1,2)} 
Is it a cyclic group? Is it isomorphic to Zę ? Consider the element (1,1). 
Now, 

2(1,1) = (1,1) + (1,1) = (0,2) 

3(1,1) = 2(1,1) + (1,1) = (0,2) + (1,1) = (1,0) 

4(1,1) = 3(1,1) + (1,1) = (1,0) + (1,1) = (0,1) 

5(1,1) = 4(1,1) + (1,1) = (0,1) + (1,1) = (1,2) 

6(1,1) = 5(1,1) + (1,1) = (1,2) + (1,1) = (0,0) 


Group Theory 15 


Here, we see that, order of (1,1) is 6, same as order of the group. Hence, 
Zz X Z3 is a cyclic group and is generated by (1,1). Thus, the group Z X Z3 
o Z¢ as all cyclic groups of order 6 are isomorphic toZg. 


is isomorphic t 
where the addition is defined 


(d) What happens for the group Zz X Z2 
component wise [ here (Zz, +) isa group] ? 
Z2 x Z2 = {(0,0), (0,1), (1,0), (1,1)} 


Now, 
2(0,1) = (0,1) + (0,1) = (0,0) 


2(1,0) = (1,0) + (1,0) = (0,0) 

2(1,1) = (1,1) + (1,1) = (0,0) 
Thus, we see that order of each element of Zz X Zz other than identity is 2, 
not equal to the order of the group. Hence, (Zz X Z2,+) is not cyclic. 
Therefore, it is not isomorphic to (Z4, +). 
Is it isomorphic to V = {e,a,b, ab}, the Klein’s 4 group? Yes, it is. You can 
define the mapping from V to Zz X Z2 by e> (0,0), a > (1,0), b> 
(0,1), ab > (1,1) and check it. 
Please, note that, example (c) and (d) show that in some cases Zm X Zn is 


isomorphic to Zmn and in some cases it is not. . 


1.4 PROPERTIES OF EXTERNAL DIRECT PRODUCTS 
If the order of each element of a finite number of groups known, can we find 
the order of any element of the direct product of those groups? Following 
theorem will clarify it. 
1.4.1 Theorem. The order of an element in a direct product of a finite number 
LA of groups is the least common multiple of the orders of the components 
of the element. In symbol, ee A 
0(91)92) 1 In) = lem ( 0(g1), 0(92), ---,0(Gn)) 
Proof. Let G = G1 X Gz X ...X Gn and g; be the identity of G; for i = 1,2, ...,n. 
Let g = (J91 921-1 Gn) EG. 
Let s = lcm (0(91),0(g2), .»,0(Jn)) andt = o(g). Now, s is a multiple of 
each o(g;) and hence, 
O° = (Ir, Izi = In)? = (O11 92, In) = (Errez en) =e EG 
Therefore, t < s. Again. 
i (91,93, ah) = (91,92, soy Bel TES (e1, €z, ên) 
So, gi =e; fori = 1,2,...,n. Therefore, t is a common multiple of o(g;) for 
i=1,2,..,.n but s is the least common multiple of o(g,),0(g2),,,0(gy)- 
Therefore, s < t. 
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Hence, Ss =t M , 
Look, theorem 1.4.1 is very helpful to solve the following problem. 


y elements of the group Zzs X Zs are of order ? 
Zs X Zs. Now, ifo(a, b) = 5 then, we have, 
o(a, b) = 5 = lem (o(a), 0(b)) 
Therefore, either o(a) = 5 and o(b) = Lor 5 or o(a) = 1ando(b) = 5, "i 


STA How man 


ellan. Let (a,b) € 


discuss two cases. 


Case- 1. 


o(a) = 5 and o(b) = 10r 5. 
There are only four elements in Zz5having order 5, namely, 5, T0, T5, 0 


If o(b) = 1 then b = 1. If o(b) = 5 then there are four Possibilities, namely 
1, 2,3, 4. Thus, there are only five choices for b. Therefore, number of elements in 
295 x Zs is4 xX 5 = 20. 
Case—2. 

o(a) = 1ando(b) = 5 

Here, a = I and b € {1, 2,3, 4}. 

In this case, the number of elements in Z25 X Zs with order 5is1x4=4 

Hence, there are only 20 + 4 = 24 elements in Z25 X Zs with order 5. 


If G and H are two finite cyclic groups then is G X H cyclic? In general, the 
answer is negative as shown in Example (d) of 1.3. | think the following theorem 


will be helpful. 


‘pem 1.4.3 Let G and H be two finite cyclic groups. Then G x H is cyclic if 
and only if o(G) and o(H) are prime to each other. 


Proof, Let G and H be two cyclic groups such that o(G) = m and o(H) = n. Then 
o(G x H) = mn. Let G =< g >and H =< h >. Then o(g) = m, olh) =n. 


Let us first suppose that G x H is cyclic and (g, h) be its generator. We shall 
show that gcd(m,n) = 1. Let gcd(m,n) = d. Now, 


(g, hE = (94, (KYE) = Cecep) 
* Since, o(g,h) = mn, we have, mn < TE which shows that d = 1. Hence, 
o(G) and o(H) are prime to each other. 
On the other hand, let G =< g >, H =< h >and gcd(m,n) = 1. Then, 
o(g,h) = lem (m,n) = mn = o(G x H) 
Thus G x His cyclic and (g, h) being its generator. 
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Note. An external direct product G; X Gz X ...x G, of a finite, number of finite 
cyclic groups is cyclic if and only if 0(G;) and o(G;) are relatively prime fori # j. 
1.5 THE GROUP OF UNITS MODULO n AS AN EXTERNAL DIRECT PRODUCT 

If for n > 1, U(n) be the set of all positive integers less than n and prime to n 
then U(n) is a group under multiplication modulo n. This is known to us. Time has 
come for introduction of some new notations. If k divides n, let 

U,(n) = {x € U(n) : x = 1(mod k)} 

For example, if you want U,(10), then first find U(10) as {1,3,7,9}, then 
U>(10) = {1,3,7,9} but we see that Us (10) = {1}. For another example, we have, 

U(21) = {1,2,4,5,8, 10, 11, 13, 16, 17,19, 20}, therefore, 

U3(21) = {1,4,10, 13, 16, 19} andU7(21) = {1,8}. 

You may ask whether U;,(n) is a subgroup of U(n). Yes, it is indeed 
because1 € U;,(n) and for x,y E U,(n) we have, x = 1(mod k), y = 1(mod k) 
which shows that xy = 1(mod k). Since U(n) is finite, we see that U;,(n) is a 
subgroup of U(n). 

Theorem 1.5.1 For a given integer n (> 1) let n=st where s,t € Zt and 
gcd (s,t) = 1 then U(n) or U(st) is isomorphic to the external direct product 


of U(s) and U(t) i.e. 
U(n) = U(st) = U(s) x U(t) 


Proof. We are givengcd(s, t) = 1. 
fx € U(st), then, gcd(x, st) = 1 =) gcd(x,s) = 1 and gcd(x,t) = 1. 
Let us define @ : U(st) > U(s) x U(t) by @(x) = (x mod s,x mod t) 
We first show that © is well defined. For that, let x,y € U(st) with x = y. Then 
st|x — y which in turn impliess|x — y, tx — y as gcd(s, t) = 1. 
In other words, x = y mod s,x = y mod t. Thus, a 
x = y => (x mod s,x mod t) = (y mod s,y mod t) => d(x) = 6) 
Next we show that @ is one-one. Let x,y € U(st) such that p(x) = o(y). 


Then 
(x mod s,x mod t) = (ymods,ymodt) =)x = ymodsandx = ymodt 


So, slx- y, tlx—y. Since, gcd(s, t) = 1, we have, st|x — y. 


Thus, x = y(mod St), i.e. x = y. 
Now, we show that @ is onto. Let (a,b) € U(s) x U(t). Then gcd(a, s)=1, 


gcd(b,t) = 1. 


e exists m,” € Z such 7 ms +nt = 
since, gcd(s, t) = : nd gcd(s,) = 1. Now, consider, z = þş 


t) i.e. 
natz EUG . we A 
it must have a prime divisor p. Again, pia a 


1 Which 
M + atn 


p cannot divide atn, for if platn then p must divide at 
orn but this is not the case as gcd(a, s) = ged( 


= i St) = 
a aai ing happens if p|t. = 
divide z. Similar thing 
= 1.5$0,P cannot 
gcd(s,7) 


gcd(z, st) = 1, in other words, z € U(st). 

Hence, d 

we bsm + atn — a = bsm — atl = tt) = Bane dine (rms am) 
z-a : ere a mod s. In the like manner, we have, z = 5 mod t 
So, S Z — s 1 . 
Hence, @(z) = (a mod s,b mod t). 

Therefore, ¢ is onto. , 

Next, we shall show that ¢ is a homomorphism. Let x,y € Uksi), 

Thus, gcd(x, st) = 1 = ged(y, st). Hence, we have, 


gcd(x,s) = gcd(x, t) = gcd, s) = gcd, t) = 1. 
Then ; 
p(xy) = (xy mod s,xy mod t) = (x mod s,x mod t)(y mod s, y mod t) 
= (x) $0) 


Hence, @ is an isomorphism and we have, U(st) = U(s) x U(t) when 
gcd (s,t) =1. 


Corollary : If m = 14N2 ....n, where gcd(n;, n) =1fori + j, then 
U(m) = U (n4) x U(n2) X ... X U(n,). 


How can we apply theorem 1.5.1? for example, we have, 70 = 2.5.7 where 
2,5,7 are prime to each other. Thus, by theorem 1.5.1, 


U(70) = U(2) x U(S) x U(7) ~ U(2) x U(35) = U(10) x U(7) 
~ U(5) x U(14) : 


The order of any of the factors in the above can be interchanged. 


We know that for each positive integer n, there is a cyclic group Zp of order n. 
In 1801, Carl Gauss proved an important result : 


U(2)= {0}, U4) =Z,, U2") = Z x Zpn-2 forn > 3 


-and ; 
U(p") = Zpn_pn-1 for p an odd prime. 
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Keeping these results in mind and applying corollary to theorem 1.5.1, we can 
express any U —group as an external product of cyclic groups. For example, 
U(70) = U(2) x U(5) x U(7) = {0} x Z4 X Ze 

And U(80) = U(16.5) = U(2*) x U(5) ~ Zz X Z4 X Z4 [ U(2*) ~= Z2 X Zz1-2] 
1.6 INTERNAL DIRECT PRODUCT 

‘External direct product of groups gives a method by which we get a larger 
group from a number of groups so that we can determine some properties of the 
larger group from the properties of smaller groups. For example, if G = H xK 
then o(G) = o(H).o(K). Any element of G can be written as (h, k) where h € H 
and k € K; if o(h) and o(k) are finite then we have, o(h,k) = lcm (o(h), o(k)). 
if H and K are abelian then G is abelian. If H and K are cyclic and 
gcd(o(H), o(K)) = 1, then G is cyclic. Now, we may ask whether we can reverse 
this process—that is, given a larger group G, can we break it down into a product 


of subgroups in such a way that it would be possible to determine many 


properties of G from properties of the component pieces. Let’s come to the 
following definition. 


1.5.1 Definition : A group G is called the internal direct product of N4, N2, -Nn 
~if 
(i) Na, N2, --, Nn are normal subgroups of G 
(ii) G = Ni N2 Nn 


(iii) Given g EG then g = mm ...mp, m; E N; (i =1,2,..,n) in a unique 
way. 


Condition (iii) of the definition 1.5.1 explains that if g € G and 


9 5 X1X2 -Xn = Y1Y2 -Yn 
where xi yi E N; for i =1,2,..,n then x; = y; for al i = 1,2, n. 


1.5.2 Example. 


1. Consider the Klein’s four group V ={e,a,b,ab}, where a? = b? = 
(ab)? = e. 


Let = {e,a} , K = {e,b}. Clearly, H,K are subgroups of V and they are 
normal as V is abelian. 


Now, H N K = {e} and HK = {e,ae,eb,ab} =V. 
Thus V is internal direct product of H andK. 
. Let G = (Zg, +) and let H = {0,2,4}, K = {0,3}. (we omit the bar symbol) 


Then, clearly, H and K are normal subgroups of Ze. Now, we see that, 
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20 G 
o=0+0, 1=473, 2=2+0 
3=0+3 4=4+1+0 5=2+3 
Therefore, G = H + K and every element of G be expressed as h+ k 
whereh E H,k E Kina unique way. 


Here is an important discussion. Suppose that G is the internal direct 
product of the normal subgroups Ni N2,- Nn- We may consider 
Ny, N2, ---, Nn as groups (let us forget that they are normal subgroups). As 
per our previous knowledge, we can form the external direct product of 
Ny, Na, --- Nn as 
T = Ni X Nz X -~X Nn 

elation between G and T? Yes, my dear reader, there is a 
how that G is isomorphic to T and if it is established 
t the prefixes internaland external, because upto 
difference between external direct product 


Is there any r 
relation. We shall s 


then we can omi 
isomorphism there would be no 
and internal direct product of groups. 


„A52 Lemma : If G is the internal direct product of N4, ..., N2 and if a E€ N;,b E 
N; for i + j then N; N N; = {e}and ab = ba. 


Proof.Let x E€ N; N Nj. Then x E G and we can write 


x = 2182 wee Of 4 XC 41 vee OF 4 ej ej+1--- En 


where e; = e being treated as the identity of N, for k = 1,2, ... n and x € N;. 


Again, we can write, 
x = 1 wee Ci—1ĉ8i2i+1 ae &j-1 x G41 Cn 


Since, expression of x is unique, we have x = e; =e. 
Hence, N; N N; = {e}. 
Let a € N;,b E N; where i +j. Since N isa normal subgroup of G, we have, 


aba™ E N,. 
Again, b € N; => b~t € N;. Thus, aba™tb™t € N;, by closure property. 


Similarly, a E N; => a1 e N;. As N; is a normal subgroup of G, we have, 


ba`1b7t E N;. 
Therefore, aba`™1b—t € N;. Hence, aba™tb™t € N; N N; = {e}. 


Thus, aba~!b-! = e i.e. ab(ba)~! = e which shows that 


ab = ba. 


Now, let us try to prove the much awaited theorem. 
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1.5.3 Theorem. Let G be a group and G be the internal direct product of 
Nay N2, «Nn. Let T be the external direct product of Ny, N3, Nn, that 
is, T = Ny X N2 X ...X Nn. Then G and T are isomorphic. 

Proof. Let us define a mapping f : T > G by 

f(y, XQ, Xn) = X1 X2 -o Xn 

where each x; € N; for i = 1,2, ..., n. We shall show that f is an isomorphism of T 

onto G. 

Let a, b (= T where a= (ay, AQ, w+ Gy), b = (by, b2, tau Dy) Now, 

fab) =a f (Cay, AQ, w05 ay) (bı, bo, ere) bn)) 
= f (ay by, a2b2, weap anbn) 
= a,b ,azb2 wy o 


But by Lemma 1.5.2, a;b; = Ba; fori + j. Thus, we have, 


a,b, a2b2 icp, De: = a1,a2 +» Ay by b2 a De 


Therefore, 
f (ab) = aybyazb2 ... dy by = a102 ... a,b bz ... bn = f (a)f (b) 
So, f isa homomorphism. 


Now, 
f(a, A2» e+) an) = f(y, bz, core bn) => Q142 ... An = bı b2 bi bn 


By the uniqueness in the definition of internal product, we have, 
a, = by, az = bz, ...,An = by, in other words, (a4, a2, -.-, an) = (b1, bz, ..., bn). 
Therefore, f is one-one. 
Now, let x E€ G. Then x =a,d2..a, where ay, E Ni, a2 E N2, ..., an E Nn. 
Therefore, 
f (ai, a2, .., an) = Q102 ...An = X 
So, f is onto. 
Hence, f is an isomorphism. 


Therefore, G and T are isomorphic m 


1.6: “CONVERSE OF LAGRANGE’S THEOREM FOR FINITE ABELIAN GROUPS 


” It has already been studied in my book Group Theory 1 that if G is a finite 
group then order of any subgroup H of G divides the order_of_G(Lagrange’s 
Theorem), What about the converse? That is, if order of a group G be nand d is a 
positive divisor of n, then can we have a subgroup of G having order d? Not sure. 


For example, order of A4, the group of even permutations of a set containing 4 
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mposition of permutations, is 12. Now, 6 is a 
subgroup H of A4 containing 6 elements? If it 
H be a subgroup of A4 such that o(H) = 6. 


elements with respect to the co 
divisor of 12. Does there exist a 


does, let’s see what happens? Let 
o(a) 122, Therefore, H is a normal subgroup of A4 and 


Then [44:4] = i 
Ag/H = Zp. Since the order of the quotient group A4/H is 2, the square of each 


element of the group A4/H must be identity, that is, for all x € Aa, (xH)* = H or 
x2H = H. That is for all x € A4, we have, x? E H. Let g be an element of A4 of 
order 3. Therefore, g= (9°) [as gi =e]. Now, g € Aq => g? E Aq => 
(92)? € H. Thus, g E H. Therefore, it is shown that H must contain all elements 
of A, of order 3. This is a contradiction as there are 8 elements of A4 which are of 
order 3 whereas order of H is 6 (< 8). 

Hence, it is clear that converse of Lagrange’s theorem is not true, in general. 
But Cauchy showed that the converse of Lagrange’s theorem holds if we consider 
the group as finite abelians. Thus, if G is an abelian group of order n and disa 
positive divisor of n, then G must have a subgroup of order d. But before that we 


wish to offer a very important theorem for finite abelian groups due to Cauchy. 


1.6.1 Theorem (Cauchy). Let G be an abelian group of order n and p bea prime 
divisor of n. Then G has an element of order p or equivalently, G has a 
subgroup of order p. 

Proof. We shall use induction on n = o(G). 

If o(G) = p, 2 prime, then o(a) = p for all a E G — {e}. Hence, the result is 
true if o(G) = 2. 

Let us assume that the result holds for all abelian groups of order r, 
where2 <r < n. Let o(G) = n. By our assumption, if for some proper subgroup 
H of G, p divides o(H), then H (and hence G) must have an element of order p. 

Thus, we assume that if H is a proper subgroup of G then p does not divide 
o(H). Since, H is a subgroup of an abelian group, H is a normal subgroup of G and 
hence we have a quotient group G/H. Now, we know that o(G) = o(H).0(G/ 
H). 
Since p divides o(G) and p does not divide o(H), it is clear that p divides 

0(G/H). Aso(G/H) <n, by induction hypothesis, G/H has an element, say aH, 
of order p. That is, (aH)? = H and hencea? E H. 
if o(H) = m then (a?)™ = e i.e. (a™)P = e, i.e. bP =e where b =a” EG. 
We claim thatb # e. If b = a™ = e then we have, (aH)™ = a™H = eH = H. 
Since, gcd(p, m) = 1, there exist u, v € Z such that pu + mv = 1. Thus, 

a = atna = (aH) aH) ™ = H [as (aH)? =H = (aH)™] 

which is a contradiction as o(aH) = p and p does not divide o(H). 
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Hence, b = a™ +e. Therefore, b = a™ is an element of G whose order is p 
mat = {(a™)':t € Z} is a subgroup of G having order pm 
Note. Cauchy's theorem can be extended to any finite group (including non- 
abelian groups), that is, if order of a group be n and p be a prime divisor of n, 
then the group has a subgroup of order p. But it is beyond the scope of the 
syllabus. | 
Now, let us come to the original problem, that is, converse of Lagrange’s 


theorem, which is not true, in general, but holds in case of finite abelian groups. 


1.6.2 Theorem (Converse of Lagrange’s theorem for finite abelian groups) 
Let G be an abelian group of order n and m be a positive divisor of n, 


then G has a subgroup of order m. 
proof. If m = 1, then {e} serves our purpose. If n = m = 1, then G = {e} and the 


result is obvious. SO, letn > 1, m > 1. We shall use induction on n. 


if n = 2, then m = 2 and G itself serves the required subgroup of order m. 
Hence, the result is true for n = 2. 

Let us assume that the result holds for all abelian groups of order r with2 < 
rín. 

Now, m must have some prime divisor, say p. So, there exists q € Z such that 
m= p.q. 

Clearly, p is a prime divisor of n. Hence, by Cauchy's theorem, G must have a 
subgroup H of order p. 

Since, G is commutative, H is normal in G and therefore the quotient group 
G/H exists. Now, 

(G) 


1 < o(G/H) = ay < 0C) 


Here, o(G/H) is - . Since, m divides n, there exists t € Z, such that n = mit. 


Therefore, 
n mt pqt 
o(G/H) Pe a 
p P p 


which shows that q divides o(G/H). Hence, by induction hypothesis, G// has a’ 
subgroup K/H such thato(K/H) = q, where K is a subgroup of G. Now, i 


o(K) = o(K/H).o(H) = qp =™ 
Therefore, G has a subgroup K such thato(K) = m. \ 


Hence proved 
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# 

i 1FUNDAMENTAL THEOREM OF FINITE ABELIAN GROUPS 

“ Now, we state a theorem, known as fundamental theorem of abelian groups, 
that describes all finite abelian groups in a standardized way. 


1.7.1 Theorem : Every finite abelian group is a direct product of cyclic groups of 
prime-power order. Moreover, the number of terms in the product and 
the orders of the cyclic groups are uniquely determined by the group. 


The proof is too long and difficult to offer and hence is omitted. 


Since a cyclic group of order n is isomorphic to Z,,, theorem 1.7.1 states thata 
finite abelian group G is isomorphic to a group of the form 


Zpri x Zp? XK sash Ze 


where the p;s are not necessarily distinct primes and the prime powers 
Py, p3 -p are uniquely determined by G. 


Solved Problems : 


1. IfA and B two groups, then prove that A x B is isomorphic to B x A. 
Solution. Let us define a map f : Ax B > B x A by 
f (a,b) = (b,a) 
letx,y € A X B where x = (a,b) and y = (c,d). 
Then xy = (ac, bd) and f(x) = (b,a), f(y) = (a, c). Now, 
f(y) = f(ac, bd) = (bd, ac) = (b,a) (d,c) = f(x) f O) 
So, f isa homomorphism. 
Again, f(a,b) = f(c,d) => (b,a) = (d, c) => b = d, 
a@=c=>(a,b)= (c,d) 
Thus, f is injective. 


f is onto, because for an 


y (a,b) E B x A, there exists (b 
ee a (b,a) EA XB such that 


Therefore, f is an isomorphism. 
Hence, Ax B = BXA, 
(In gene i 
ee external direct product of any number of groups is isomorphic to 
irect product of any rearrangement of those groups.) 


2. Prove that the 
group of com r iti r 
ie) plex numbers unde addition is isomo phic to 


Solution. L 
a, et C denote the group of complex numbers under addition 
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pefine f : C> Rx Rby f(a + ib) = (a,b). 
tet atib,c+id EC. Then 
fila + tb) + (c + id)] = f[(a + c) + ilb + d)] 
=(a+c,b+d) 
= (a,b) + (c,d) 
= f(a + ib) + f(c + id) 
So, f isa homomorphism. 
tet a+ib,c +id EC such that f(a + ib) = f(c + id), that is,(a,b) = (c,d) 
Thus, a = c,b = d. Hence, f (a + ib ) = f(c + id) => a + ib =c + id. 
Therefore, f is injective. 
For (a,b) € R X R, there exists a + ib E C such that f(a + ib) = (a,b). 
So, f is onto. 
Hence, f is an isomorphism. In other words, C= Rx R. 
3. Prove or disprove : C”, the group of non-zero complex numbers under 


multiplication, is isomorphic to R” x R* where K* denotes the group of 
non-zero real numbers under addition. 


Solution. The statement is wrong. Because, in R* x R* there are three elements 


of order 2, viz. (1,—1), (—1,1), (—1, —1) whereas, C* contains only one element 
of order 2, that is, —1. This cannot happen as isomorphism preserves order. 


4. Prove or disprove :Z x Z is a cyclic group. 
Solution. The statement is false. We know, that Z =< 1 > but (1,1) is not a 
generator of Z x Z as (1,2) € < (1,1) >. Hence, Z x Z is not cyclic. 


5. Is Z3 X Zo is isomorphic to Z27 ? 


Solution. No, as gcd(3,9) = 3 # 1. We know that Zm X Z, is isomorphic to Lae 
if and only if gcd(m, n) = 1. 


6. For each integer n> 1, give examples of two non-isomorphic groups of 


order n?. 


` Solution. Z,2 and Zn XZ, as Z,2 is cyclic whereas Z, X Z, is not cyclic as 
gcd(n,n) =n>1. 


7. Let G be a group with identity eg and H be a group with identity ep. 


Prove that G is isomorphic to G x {ey} and H is isomorphic to {eç} x H. 


Solution. Let us define a map f : G > G x {ey} by f(g) = (g,ep) 
4 
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if ga gz E G, we have 
fan) = (gizen) = (91. en) (G2, en) = FOD (G2) 

So, f isa homeomorphism. 

Let g gz € G such that fa) = Fg2)- 
Then (gy eg) = (g2: €n). that is, 91 = 92 

So, f(g) = f(g2) => 91 = 92 in other words, f is injective. 

for any (g, ey) E G X {en}, there exists g E G such that f(g) = (9, ep). 

So, f is onto. 

Thus, f is an isomorphism. Hence, G =G x {ep}- 

Similarly, taking $ : H > {eç} x H defined by @(h) = (eç, ħ), it can be 
shown that H = {eg} x R- 


8. if G xH is cyclic, prove that G and H is cyclic. 


Solution. By problem 7, it is clear that G =G X {ey}. Now, Gx {ey} is a 
subgroup of G X H and hence is cyclic as any subgroup of a cyclic group is cyclic, 
Thus, G is cyclic. Similarly, it can be proved that H is cyclic. 


9, if agroup has exactly 24 elements of order 6, how many cyclic subgroups 
of order 6 does it have? 


Solution. Let G be a group having exactly 24 elements of order 6. Now, any cyclic 
group of order 6 is isomorphic to (Ze, +). Since, Zg has exactly two generators, 
any cyclic group of order 6 has exactly 2 generators. Thus G can have exactly 12 
subgroups of order 6. 


10. If an abelian group G is the internal direct product of its subgroups H and 
K, then prove that H = G/K and K = G/H. 
Solution. Let g E G. Then g = hkwherehE H,k EK. 
letus define f : G > H by f(g) =hand F : G > K by F(g) =k. 


Let 93,92 E G. Then gı = hiki, g2 = hkz where,h;, h2 E H and kı k2 € 
K. Now, 


f(9:92) = f (hikıhzk2) = f (hih2k;k2) [as G is abelian] 
= hhz = f(g) f(92)- 
Therefore, f isa homomorphism and f is onto by definition. 
x € kerf <=> f(x) =e <= > x = ek,Yk EK 
Thus, kerf = K. Hence, by 1* isomorphism theorem, 
G/kerf = H,i.e. G/K =H. 
Similarly, it can be proved that G/H = K. 
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41. If T= Gi X G2 X -X Gn prove that for each i= 1,2, .., there is a 
homomorphism f; of T onto G;. Find the kernel of f;. 


solution. For some i € {1,2,...,n}, let us define f; : T > G; by 
Fi(91) 920+» Gi-1,9i iti win) = gi 
Let (gi. O2: Gi-1 „Ji Git1 In) (hy, hz, aay hy-4 „hi i Ajay ia ha) E T. Then 
filgu 92 wer Gi-1 Gi Git In) = gi fi(h, ho, a hi1 j hy Risa ee hn) = hi 
Now, 
fil€ov gz: GJi-1 Ji Gi+1 On) (hı, ho, we hi1 h; Ajay --ha)] 
= figyhy, s Ji-1ħi-1, Jihħi Ji+1hi+1 + Inha) = gihi 
= filg Iz = Ji-1 Gi, Ji41 sa Ga Fi Ras hiara hits ba rigs + In) 
which shows that fi isa homomorphism. 
For any gi E€ Gi there exists (91, 92 w Gi-1 Gi, Git ga) € T such that 
Fi G1» G2 Gi-1 Gi.Gi+1 On) = Gi 
Hence, f; is onto. 
Clearly, kerf; is given by 
kerf, = (CEA vee Gi-1 i Git sin) : gk E Gk k = Zeon} 
where e; is the identity element of Gi. 
12. What is the order of any non-identity element of Z3 X Z3 X Z3 ? 


Solution. We know that order of any non-identity element of Z3is 3 (in fact, order 
of any non-identity element of Z, is p, p being prime). Let (a,b,c) E€ Z3 X Z3 X 
Zz where (a,b, c) + (e,e, e). 


Now, order of (a, b,c) islcm{o(a), o(b), o(c)} = 3. 
13. What is the largest order of any element inZ39 X Z20 ? 
Solution. Order of (1,1) = lem {30,20} = 60. 
14. Let G; and G2 be two cyclic groups of order 2 and 3 respectively. Prove 
that G = G4 X G3 is acyclic group of order 6. 


Solution. Let G, =< a > and Gz =< b >. Since order of G; and G2 are 2 and 3 
respectively, we have, o(a) = 2, o(b) = 3 and we can write 


G1 = {e1, a}, Gz = {e2, b, b?} 
where e; and ez are the identity elements of G, and G2 respectively. Now, 
G = Gy x G2 = {(e;, ez), (ei, b), (e; b?), (a, e2), (a, b), (a, b?)} 
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It is clear that G is a group with respect to the operation (a,b)(c,d) = 
(ac, bd). 
Let g = (a,b) E€ G. Then 
g? = (a2, bD = (€1,2), g° = (a3,b3) = (a, €2), 9" 
g5 = (a5, b5) = (a,b?), g° = (a®, b®) = (e1, €2) 


Hence, G =< g > is a cyclic group of order 6. 


= (at, b*) = (e1, b) 


15. Let G be a group and T = G x G. Then show that , 
(a) D = {(g9,.g9) EG X G:gEG}is isomorphic to G and 
(b) D is normal in T if and only if G is abelian. 


Solution. 
(a) Itis easy to show that D is a subgroup of T. 


Let us define a map f : D > G by f@g.g) = g. Now, 
fig, gh h)] = f(g, gh) = gh=fiagfhh) 


So, fisa homomorphism. 
To show f is injective,let (g,g), (h,h) E D such that f(g, g) = f (h, h). 


Then g = h which implies (g, g) = (2, h), that is, f is one-one. 


By definition, f is onto. 
Hence, f isan isomorphism. In other words, D = G. 
Let D be a normal subgroup of T.Let a,b €G. Then (a,e) ET and 


(b) 
(b,b) E D, e being the identity element of G- Since, D is normal in T we 


have, 
(a, e)(b, b)[(a, ej) 1 € D => (aba™t, ebe™*) E€ D 


=> aba™! = b => ab = ba 


Therefore, G îs abelian. 
let G be abelian. Let (a,b) € T and (g,g9) ED 


Now, Ca, b) (g, pla by]? = (a, b) (g, g)(a7™t, b+) 
= (aga, bgb™ =(g,g) ED 


Conversely, 


[ as G is abelian, aga™ = aa™*g =g, bgb™! = g] 


Hence, D is a normal subgroup ofT. 

16. Give an example of a group G and normal subgr 
thatG = N,N2...N, and N; N Nj = {e} for i + 
internal direct product of N1, N2, ---, Nn- 

a2, b, b?, ab, a?b?} where ab = ba, a? = b? = e. Then G 

= {e,ab,a*b7}, Nz = {e,b, b2}. Then 


oups N1, N2, --, Nn such 
j and yet G is not the 


olution. Let G = fe,a, 
an abelian group. Let N; = {e,a a°}, M2 
1 Nz, No are subgroups of G and each of them is normal as G is abelian. 
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Clearly, G = NiN2N3 and N; N N; = {e} for i # j. But we see that ab € G and 


ab = eabe = aeb 
That is, ab has two different representation. Hence, G is not the internal direct 
product of Nz, N2, N3 as in that case each element of G would have unique 


representation, 
17. Let G be a group and Ky, K2, ..., Kn normal subgroups of G. Suppose that 


K,NK29..0 Ky = {e}. Let V; = G/K; for i=1,2,...,n. Prove that 
there is an isomorphism of G into Vy x V2 x... Vn. 
on.Let us define a map f : G > V1 X V2 X... X V, by 

f(g) = (9K1, 9K2, --, 9Kn) 


which is not the case. 


Soluti 


For gh E G, we have, 
fCgh) = (ghK,, ghKo, ...,ghKn) 


= (9 Ky, gK2, .-, gKn) (h Kı, AK, a hK) 
=f DW 


Therefore, fisa homomorphism. 
To show f is injective, let g,h E G such that f(g) = f (h), that is, 


(9 Ky, 9K2, we, gKy) = (hKy, hK2, ..., AK) 
So, gKı = AKy, gK2 = Kp, , gKn = hKy. Thus, 
g th € Ky, g 1h E Kz, ...,g “he Kp 
Whichshows that g~1h E K, N Kz... Ky = {e}(given). 
Hence, g th=e,i.e. g=h. 


Therefore, f is one-one. 
Hence, G is isomorphic to f (G), a subgroup of V1 X V2 X X YY. 


18. Show that every group of order p?, p a prime, is either cyclic or is 
isomorphic to the direct product of two cyclic groups each of order p. 


Solution. We know that every group of order p? is abelian. Let G be a group of 
order p°. 
Order of each element of G is either 1 or p or p?. 


If there is an element in G of order n*, then G is cyclic. 
So, let there be no elements in G of order ae Let h E G,h + e. Then o(h) = 


Let H = {h" : n € Z}. So, o(H) = p. 
Thus, G — H + Ø. Let k € G — H and K = {k” : n E Z} and hence o(K) = p. 


Now, H and K are two subgroups of G and they are normal as G is abelian. 


Clearly, o(G) = o(H)o(K) and H N K = {e}. So, G = HK. 
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Let x E G . If x has two expressions likex = Ak" = hSk‘, 
then APS =k" = eas NK = {e}. 
So, each element of G has unique representation. Therefore, G is the interna 


direct product of H and K. Hence, we can say that, G is isomorphic to the direc; 
product of two cyclic groups each of order p. 


19. If G = K4 X K3 X ...x K,, describe the centre of G in terms of those of the 
Ki. 
Solution. Let Z(K;) denote the centre of K;. Thus, 
ki € Z(K;) => kigi = gik Vai € Ki; 
We claim that centre of G, denoted by Z(G), is given by 
Z(G) = Z(K1) X Z(K2) X ...X Z(Ky) 


as(kı, kz,- ., kn) € Z(K1) X Z(K2) X ..X Z(Ky) implies for any(g1, 92,- 9n) € 
G 


(ky, kz, ase kn) (ga. 92: wa Gn) 
= (kigik2g2, wn Gn) 
= (giki, g2k2, +) Inkn) 
== (91, Jz: On) (ka, kz, ay Kn). 


20. Suppose that @ is an isomorphism from Z; X Zs to Z15 and #(2,3) = 2. 
Find the element in Z; X Zs that maps to 1. 


Solution. Since, @ is an isomorphism and@(2,3) = 2, we have, 
8¢(2,3) = 16 = 1 (in Z,s) 
Now, 8 (2,3) = (16,24) = $ (1,4). The required element in Z; x Zs is 
(1,4) 8 
21. What is the largest order of any element in U(900)? 
Solution. We know that 
U(2) = {0}, U(4)=Z, U2") = Zz X Z-z forn= 3 

and U(p") = Z,n_,n-1 for p an odd prime. 

Now, 900 = 4~x 32 x 52. 

Thus, U(900) = U(4 x 3? x 5?) = U(4) x U(32) x U(S*) = Zo X Ze X Zp. 

Hence, largest order of any element is lem {2,6,20} = 60. 


22. Give an example to show that there exists a group with elements a and b 
such that o(a) = œ, 0(b) = œ but o(ab) = 2. 


Solution. Let us consider the group Z x Z2. Take (1,1), (—1,0) E Z X Zp. 
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(4,1)'='00, o(—1,0) =e but 


O 
i o((1,1)(-1,0)) = 0(0,1) = 2 


na odd primes and let m and n be positive integers, then check 
23. Let P: 
whether 


u(p™) x U (q”) is cyclic. 
q are odd primes and m,n € N, we have, 


lution. Since, P. 
So U(p™) = Zym—pm-1 = Zy™-1(p—1) 


AndU(q”) = Zgn-1(q-1) 
Thus, U(p™) x U(q") © Zym-1(p-1) * Zq"-1(q-1) 


m) x U(q") is not cyclic as Zym-1(p—1) * Zq%-1(q-1) is not 


which shows that U(p 


cyclic as 

acd(p™ (p —1),4 

know that Zm X Zn 
24. Check whether U(55) ~ U(75). 

U(55) = U(5.11) = U(5) x U(A1) = Z4 X Zio [ U(p) = 


n-1(qg—1)) 22 (asp-1q-1 both are even) [Since we 
is cyclic if and only ifgcd(m,n) = 1] 


Solution. We have, 


Zp -1] 
sth (75) = U(5?. 3) ~ U(5*) x U(3) ~ Z(52-5) X Z2 


[U(p") = Zpn—pr-1] = Zz X Zz = Z4 X Zs X Z2 = Za X Zio 
Hence, U(55) = U(75). 
25. What is the smallest positive integer k for which x* = e forall x in U(pq) 
where p,q are distinct primes. 
Solution. We have, U(pq) ~ U(p) x U(@q) ~ Zp-1 X Zq-1 
Thus, k= lcm {p - 1,q — 1}. 
26. Let p be a prime. Show that if H is a subgroup of a group of order 2p that 
is not normal, then H has order 2. 


Solution. Let G be a group of order 2p. Clearly, G and {e} are normal. Using 
Lagrange’s theorem we can say that the order of all other subgroups have either p 
or 2. If H is a subgroup of order p, then we have, 


_o(G) 2p _ 7 

~ ol(H) p 

and hence, H becomes normal in G. 

Therefore, any subgroup of G that is not normal in G, must be of order 2. 


[G : H] 
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27. Let H,K be subgroups of a commutative group G. Let o 


o(K) = t. Letd = lcm {s, t}. Show that G has a subgroup of 


(H) =S and 
Solution. 


order d. 
Given G is commutative. Therefore, HK = KH and hence, HK jg 
subgroup of G. Now, order of HK is finite as o(H) and o(K) are finite. A 
Since, H and K are subgroups of HK, by Lagrange’s theorem, we have 
mlo(HK), njo(HK). : 


So, dlo(HK). Since, HK isa finite commutative group and d is a divisor of 
o(HK), we assert that HK hasa subgroup of order d. 


Hence, G has a subgroup of order d. 


28. Let G be a finite commutative group and k be a positive divisor of 0(G) 
Let i i 


H = {x € G : x" = e} . Prove that o(H) is a multiple of k. 


Solution. Since G is a finite commutative group and k is a positive divisor of o(G), 
by converse of Lagrange’s theorem for commutative groups, G has a subgroup of 
order k. Let it be K, that is, K isa subgroup of G such that o(K) = k 


Now, xE€K=>x" =e=>xEH. Thus, K S H. Hence, by Lagrange’s 


theorem, o(K)|o(H), i.e., kļo(H). In other words, o(H) = kt for some positive 
integer t. 


Hence, o(H) is a multiple of k. 


29. Let G be an abelian group and a,b E G be of order m and n respectively 


where gcd (m,n) = 1. Show that there exists an element c of G such 
that o(c) = k where k is the LCM of m and n. 


Solution. Given that k = LCM {m,n} and gcd(m,n) = 1. Therefore, k = mn. 


Put c=ab€G.Then ck =c™ = (ab)™ = (a™)"(b")™ [as Gis abelian] 
=e. 


Thus, o(c)<k. Let o(c)=t. 

Then t < mn. 

Now, e= ct = afb! => at = b => a*t = pom 
But a"! = e => po = e => b™ =e. 

o(b) = n implies n|mt. Therefore, n|t as gcd(m,n) = 1. 
Similarly, it can be proved that m|t. Thus mn < t. 


Hence, mn=t. 


Thus it is shown that o(c) = mn. 
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Exercise 

G =H x K. Show that G is abelian if and only if both H, K are abelian. 
e — H x K, where G is a finite group. Show that o(G) = o(H)o(K). 
ee that the order of (8,4,10) in the group Z12 X Zso X Z24 is 60. 
3. spie G is the internal direct product of its subgroups H, K, then 
4. 


10. 


11. 


12. 


G 
H = G/K and7, = K. 


[ Hint : For any x E G, x = hk, h E H,k € K. Define f : G > H, g:G > 
I . 
x) =h, l 
Aa Show that f and g are homomorphisms onto H and K 
o e i = dkerg=H] 
tively with kerf = K an g 7 
oa a > be any cyclic group of order , where gcd(m, n) = 1. Let H 
d K be its subgroups of orders m and n respectively. Show thatG = 
an 
oes —-<a> , G2=<b> be two cyclic groups of order m and 
aaNet such that gcd(m,n) >1.Show that G =G, X Gz is an 
abelian group of order mn, which is not cyclic. E l 
Let G be a direct product of two subgroups, each of which is a cyclic group 
t be cyclic. 

f order 5. Show that G canno l l nA 
ave be a finite group having at least three elements in which a* = 
e ya E G. Show that G is internal direct product of a finite number of 
subgroups each of order 2 and o(G) = 2” for somen 2 2. E 
if Z(G) denotes the centre of a group G, then prove that Z(G x H) i 
Z(G) x Z(H), G,H being groups. Hence deduce that G x H is abelian if 
and only if G and H are abelian. 

Let N be a normal subgroup of a group G. If G = HxK where H and K 
are subgroups of G then prove that either N is abelian or N intersects H 
or K non-trivially. 

if M and N are normal subgroups of a group G then show that G/(M N 
N) = G/M XG/N. 

[ Hint: Define f : G > G/M x G/N by f(g) = (9M, gN).] , 

Let G be a group and H = {(g, g) : g € G}. Show that H is a subgroup of 


Gx G. Further, H is a normal subgroup of G x G if and only if G is 
abelian. 
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2.1 LINEAR ALGEBRA II 


It is assumed that readers have su 


basis or dimension. But one thing should be noted that in the 

Linear Algebra 1) no concepts of length, angle and distance we 
i geometry, we have idea of dot product of vectors. Keeping th 

introduce a new concept inner product on a vector space. 


fficient knowledge of Vector s 


earlier part (See 
re introduced. In 
at in mind, let Us 


2.1.1 Definition. An inner product on a vector space V over a field F isa 
A map< ,> :V xV >F satisfying the following properties : For a, By EV and 
CEF, 
(i) Sathy > =<ay > repy 


Aii) <ca p >=c<a p> 


A) < a, P >=< B, a > where the bar denotes 


complex conjugation 
vliv) <a, a >> 0ifa + 0. 


Conditions (i) and (ii) simply require that the inner 


component. It is also to be observed that condition 


s (i), (ii), and (iii) together 
imply 


<a,cB+dy >=<cB+dy,a> 


=c<B,a>+4+d<y,a> 
=€<B,a>+d<y,a> 


=c¢<a,pB>+<a,y> 


2.1.2 Definition. A complex vector space V together with a complex inner 
product defined on it, is called a Unitary space. 


2.1.3 Example. On F” 


there is an inner product which we call the standard inner 
Product. 


Ifa = (a4, @2,...,a,) and B = Cbi, bz, ...,b,)in F”, let us define 
n 
<a, >= H aibi 
i=1 
Ify = (c1,c2, ,c,) E F”, we have, 


34 


Paces and its: 


Product be linear in the first. 
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Vea +5 he 
(i) <atpy7= i-a; + bi)t Bispat die biG; 
: =<&,y > +<ß,yY > 


i) < ca poa Na ca;b; = c De, aibi =c < a, B > 

ii , we EN at ao 
) Za, b >= dia aibi = Xf- abi = Liar tbi = Xi- ba; =< p,a 

(iii) zæ 


"si « So, 
(iv) Ifa + @ at least one of a;’s is non zero. S 
i 


n n 


<aa>=) a=), 


la;l? >0 
i=1 i=1 
Thus, properties of inner product are satisfied. 
is, i fine 
R, the conjugations are not needed, that is, in that case, we de 
fF =, 
<a, B > = abı + azb2 + + + Andy m 7 
i a. 
dard inner product is usually called the dot product and is denoted by 
This standa | 
instead of < a, ß >. . 
We wish to define real inner product in a separate way. 


i <>: 
Definition. A real inner product on a vector space V over ‘a eee, 
4° Defi . ' chase i 
we > R satisfying the following properties : For a,B,y €V an 
Y 
i) <at+B,y>=<GyY> +< B,y >and 
<aBpty>=<ap>t+<a,y> 
ü) <a,p>=<B,a> 
(iii) <ca,B >= c<a,p> o 
liv) < a, a > 2 Oand< a,a > = 0 if and only fa = oð. 


Now, (V, <, >) is called an inner product space. 


i nit, 
BS Definition. A real vector space V together with a real product defined o 


~iscdlled a Euclidean space. 


fae n wi ssumed 
Convention :Unless specified otherwise the inner product on R will be a 
to be the dot product. 


2.1.6 Examples. 
1. For u,v E€ R@where u = (u, u2), v = (vi, v2), let us define 
<u, v >= v4 (uy + 2Ug) + V2 (2u,. + 5u2) 


It is easy to verify that this product satisfies the properties (i), (ii) and (iii). 
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Now, = 
SU,U > = uy (uy + 2uz) + ug(2u, + Sup) 


= uj + 4uyu + 5u3 
= (uz + 2u2)* + uf 


Clearl 
: i ; ae and <u,u>=0 if and only if (u + 2y,)2 
and uz = 0, that is, if and only if u; = 0, uz = 0. Thus, < an5 
only ifu = 8. l a 
3 A 
Thus, R“ becomes a Euclidean space under this inner product. 


2. i C 1 V 
. J J , I e 


1 
<fig>= [ Oaar 


It is easy to check that conditions (i), (ii ii 
, (ii) and ifi 
one, we have (ii) (iii) are verified. To check the last 


1 
<f.f>= | FOPdazo 
0 


Now, <f,f >= 0 ifand only if f = 0 (follows from Analysis). 
Thus, (C[0,1], <, >) is an inner product space. 


ba Definition. Let (V, <, >) be an inner product space. The length or norm of 
a eens E V, denoted by ||v|l, is defined by ||v|| = +V<v,v>, that is, th 

norm of a vector v is the positive Í 7 , the 
oS positive square root of the non-negative number 


For example, ifv = (14, V2,...,V¥,.) E F” with standard inner product, then 
loll =+f<v,v >= +p + vT +--+ 0,0, 
= J lv, [2 + [vz]? +--+, [2 


A oe pec feels uncomfortable with abstract inner product spaces, he may 
e advised to assume that the inner i i i 

' product space is R” 

iE e A p with the dot product 


2.1.8 Theorem. Let V be a real inner product space and v E V. Then 
(i) [|u|] = 0 and||v|| = 0 if and only if v = 8. 


(ii) ||cv|| = Įelllv]|[forc € R 
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ctor v E V, there is a vector u E V such 


for any non-null ve 
lled the unit vector alongv. 


hermore, i j 
il y = |lvllu. This u is ca 


that llull =1and 


proof. 
(i) since, ivl = + 
|= Qif and only if < v, 


Zv,v >, we have, \|v|] = 0 and 


v > = 0 if and only if v = 8. 


lvl 
ji) We have, , 
| EESE E AEA SBP 
Hence, Ilcvll = [clllvll. 
2. Then liull = Hi = land v = |lv|lu. 


for last part, take U = ivi 


Hence proved. 
d: working with norms squared is usually easier than 


one thing is to be note 
working directly with norms. 


2.1.9 Cauchy-Schwarz’s inequality 
\” tet bean inner product space over F. Then for u,v E y, 
|< uv >| < lul. lll 


a a an 


proof. If v = 9, then < u80 >| =0= llull. [|@ |]. So, the proof is done. 


Let v # 0. For any €C e F, we have, 
0 < lju- cvl? =<u-—cv,u—cv > 
=<uu-—cv> -c <v,u— cv > 


=<u, u> -E<uv>—c<vurtcc<vyv> 


Taking c= aes, we have, C = suz and thus, 
<vv> <v,v> 
2 2 > E 
0< |lu- cvl? = llull* — <2 44 > 
<v, Vv > 
<u,v> Up Sue > 
- <vu> tooo <0 > 
<v, v> <v, V >.<vV, v> 
i.e. 
(<u, v>) <u v> 
o< lul -=> [as < urs >] 


lvl]? 
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Therefore, 
<u,v >|? 
0< llull? _l<uv>/ 
llv]? 
i.e. |< uv >|? < Ilull?lv]]2 
Hence, 


|< u,v >| < lull lv]. 


Note. If we take V as Euclidean space then no conjugation required, th 
and 


at is, cx 
< u,v > =< v,u > lead to the conclusion. m 
If we take V = R” with standard inner product, then for a,b € R” Wher, 
S ‘ Bee eas 
(a1, a2,.., an )and.b = (b, bz, ~- bn), using Cauchy-Schwarz’s inequality, we a 
|< ab >|? < |lall? |b]? 


That is, 


(a,b, +azbz +++ dnb)? < (a? +a? +--+ an) (by + b? + + b?) 
which is a well-known result in Classical Algebra. 


2.1.10 Triangle Inequality 


Let V be an inner product space over a field F. Then for all uveV 


Ju + vil < lulli. 
Proof. We have, Pet abet, © re eee 


llu + vl? =<utveutv> 


=<uur> t+<uv> +<v u> +<v,v> 
= |lull?+<u,v> +< u,v >+ |lv||? 
= |lu]? +2 Real < u,v > +]lv|l? 
< Jul]? + 2|< u,v >] + |lvll? 


< llull? + 2[lullllvl] + lvl? [by Cauchy Schwarz s inequality] 
= (llull + lvi)? 
llu + vl] < [lull + lvl]. 
We have learnt in vector algebra for R? or R? that <u, v >= |lullllv|| cosé 
where 0(0 < 0 < 7) denotes the angle between uand v. We also know that two 
non-zero vectors u and vare perpendicular if and only if cos@ = 0, that is, if and 


only if < u,v > = 0. Then can we generalize the notion of perpendicularity to 
arbitrary inner product spaces? Let’s try. l 


Hence, 
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Vectors u and Y in: V are 


finition Let V be an inner product space. 
1 Definition perpendicular) if < wv >=% +j 
2.1.1 “Ahogonal (perpendicular) >= Ofori #J- 


v,} of V is orthogonal if < vi Vj 
Un 


i . 
any non-null vector In y, then 


“a subset $S = {v1 , 
n nit vector if \|v|| = 1. If v is 


a vector Y inV isau 
v jg a unit vector. 
M subset S= (v4, V2» ss Vn) ÎS sai 
and < MY > = 1fort 5J. 


; ra See 
d to be orthonormal if < Vj 7 


ew ore, 8 is the only 
a il vector 8 is orthogonal to any vector. coon contain @ but 
m a ih is orthogonal to itself. So, an a tcetel set consisting of 
: w | set is an O 
vector In not. An orthonorma 


an orthonormal set can 


unit vectors only. 


= is orthogonal as 
mple. In F*, the set s = {(1,1,0), (£ —1,0), ( 1,1,2)}is 
2.1.12 Exa . ’ ý ai 
< (1,1,0), (1, 1,0) >= 1.1 + 1(-1) +0 a 


< (1,1,0), (1,1,2) >= 4(—1) + 1.1 + 0.2 = 0 


= 0 
an , I J 


y 24 02 = V2. However, 
t orthonormal as II, -1,0)I1 = 12 4+ (—1)2 +0 JZ 


But S is no from S by normalizing the vectors, as 


we can obtain an orthonormal set 


l A 1 PT A —1,1,2) 
(pery. , 6 } 


lu + vil? = luli? + Iv ll? 


aren 


Proof. We have, 
ut vi? =<utvutv 


=<u,u> +< tbe > + vu> t< v.v > 


— =0 
= lull? + lvl [as < u v > 5< YY >= 0] 


Hence proved. 


i Id 
Note. If we take V = RÈ, then theorem 2.1.13 matches with the 2500 years 0 
Pythagoras theorem what you read in school level geometry. 
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2.1.14-Parallelogram law 
ww If u, v be any two vectors in a Euclidean space V, then 
lu + vl? + |lu = vl)? = 2 llull? + 2 llv]? 
: eee a 
Proof. We have, 
utov|i?=< = 
|| || u+tv,u+v>=<uu> FLuọv>+<vu> A: 
= |lul? +2 < uv > +lvll? (1) 
Similarly, l 
lu — v||? = |lul]*@-2<uv> Hol ... (2) 
By (1)and (2), we have, 


lu + ull? + |lu — vll? = 2llull? + 2]ļv||?m 
^ 
21.15 Theorem. An orthogonal set of non-null vectors is linearly independent 


Proof. Let S be an orthogonal set of non-null vectors in a given inner 


space V over a field F.Let Vi V2,.., Vk are distinct vectors in S such that fo 
Cia Chag Cy EF, 


C101 + C2 V2 +e + Cn Vy, =0 
Then for k E {1,2,..,n}, we have, 
< C1 v1 + C2V2 a ol Cn Vn: Vk >= 0, Vk >= 0 
=> C1 < Vy Vk > +62 < Va Vk > ++ Ck < Ve Vk > He + Cy < Vp V> 
=0 l 
=> Ck < Vy, Vy >= O [as < vpvp >=0 ifi+k] 
Since, < Vk, Vk ># 0, we have, cy = 0 for k = 1,2,..,n. 
Hence, S is linearly independent. 


Corollary. Any orthonormal set of vectors in an inner product space is linearly 
independent. 


Let u,v E V where V is an inner product space over a field F. Let v # 8. Let us 


try to write u as a sum of some scalar multiple of v and a vector w which is 
orthogonal to v. Let a € F. We wish to express u = av +w 


wherew is orthogonal to v. In other words, < w, v > = 0, that is, 


< u- av,v > =Q, Le. <uv> —a<vv>=0 


Thus, 
<uv> 
a =—— 5 
lvli? 
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nt choice ofa, we have, 
Ss dab! cons 
u= = V 
IIvll 
s orthogonal decomposition, 
pace V 
going to prove it fo 


<u,v > ) 
s V 

Ivl 
can be used to prove 


Theorem 2.1.9 proved 
r general 


ique, known a 
This techniqu uality for any inner product S 


we are 
cauch ult nar guclidean spaces only. Now, 
this res 
case. 
e V, then i 
orem. lf u,v 
2.1.16 The [< uv >| < eal ical nigiaot 
r i calar multi 
suality is an equality if and only if one of u, V 1Sa 5 
This ineq 
ther. = 0 = llull? loll. 
other ity =6,then [<8 >| =0= lul ji i 
u, i io 
duns + 0. Letus consider the orthogonal decompos! 
let V f 
So, <ur> 
u = — a l +W 
IIvll 


wherew €E Vand<w,v >= 0. 


By the Pythagorean theorem, 


2 
v> 
I | + llwll? 


2 = 
llull lvli? 


< uv >|? 2 
=> ful? = ÉZ Las Iwl? = 0) 


v 

v||? 
2 

=>|<uv>|’s lull? lvl 


Taking the square root, i 
|< uv >| < llullllvll. 


2 , -nN i 
szy , if and only if, llw]|2-= 0, if 
vil? 


A 2 
Equality holds if and only if |lull“ = | 


and only if w = @. 


multiple of vm 
5 and its corollary it is clear that every orthonormal set 


oduct space with dim V =n. 
elements is a basis of V. 


By theorem 2.1.1 í i 
vectors is linearly independent. Let V be an inner p 
Then any orthonormal set of vectors in V containing 7 


6 
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For example, standard basis of F”. In general, if {v1,V2,--, Vn} is a basis of V, then 
any element v of V can be expressed as 


v = a11 T azv +° + anYn 


for some choice of scalars @1,@2,...,@y- But it is not so easy to find these SCalars 
However, this is easy for orthonormal basis. The next theorem will support it. 


2.1.17 Theorem. Let {e1,€2,..-,@n} be an orthonormal basis of Vand v ey 


Then 
v =< v,€1 > €1+ < V, €2 > €2 +< V, €n > en 


and |lv||2 = |< v, e1 >|? + |< v, e2 >|? +--+ |< v,e, >l 
Proof. Since, {e1, €2,-., €n} is a basis of V, we have, 
v = Q181 + A222 + + Anen 
wheredy, Q2,..,Q, are scalars. 
Now, < v, ej > =a, <e1,6 > +a < €2,86; >t +aj < 6j, 6j > 
++ an < en 8 > 
=q(as <¢,6 >=0 fori #jand<6,e >=1) 
for j = 1,2,..,n 
Thus, v = < v,e > eyt< V,ez > €23 + +< V, €n > ey 


By repeated application of Pythagorean theorem, we have 
lvl? = |< v,e; >|? + |< v,ez >|? +-+ |< v, en >|? m 


I think, now the usefulness of an orthonormal basis is clear. So, can we convert 
a given basis of V to an orthonormal basis of V? The answer is given by the 
following theorem that includes a process, known as Gram- Schmidt 
orthonormalisation process. 
2.1.18 Theorem . Let V be any finite dimensional inner product spacewith 

dimV = n > 1. Then V has an orthonormal basis. 

Proof. Let {v1,12,..,v,} be a basis of V. We first try to produce an orthogonal 
basis of V. 
Let uy = v4. 


We define, u, = <v2,u1> 
2 = 02 —- z U 
llul? “1 
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<v2,u4> 
= <v -~ ui uU > 
Then,< Uz Ur >= < V2 T ye VPM 
< v2, u1 > 
= < v, > -— 5z < u, u >O 
: llu; II? 
<v2,uU4> 
i = hen v> = =y; shows that 
Moreover, uz +0. Because, if u= t 2 = hal t 


(vY Je linearly dependent and hence {v1, V2, Vn} is linearly dependent 
V1, Y2 
which is not the case. Let 
< v3, U1 > < vatu > 
u = v -= uy = 
3 hal? TAE 
Now, 
< vsu >? < v3, U2 > _ 
= -22  e uu > —— << u, Uu = O0 
< uz, u1 >= < v3, 14 > AE ru ae 


Similarly, <U3,U2 >= 0 


+ 0 . For otherwise, v3 isa linear combination of u4 and uz and hence a linear 
a EANA of vand v2. This implies {v1, v2, V3} is linearly dependent, a 
contradiction. 
Proceeding as above by induction, define, 


< Vk, Uy > < Vp, U2 > 


< Vk, Up-1 > 
= ù ooo U La ST SY 
Uk = Pe ful? ual? 


u — 
$ llug- ll? 


uk-1 


Then, < up, u; > = 0 for 1 <i < k-— 1 and as before ug + 8. 


This process terminates after n steps and thus we have produced an 
orthogonal basis {u1, Uz, .-., Un fof V. 


Hence, we get an orthonormal basis {e;,€2,...,€,} of V where e; = 
for i=1,2,...,n 


piled a 
Weel 
Therefore, proof is complete. 


2.1.19Example. We wish to form an orthonormal basis of R? from a given basis 
{(—1,0,1), (1, —1,0), (0,0,1)}. 


Let uw; = (—1,0,1). Then 


< U2, Uy > 
uz = uz -—— U 
a Ja 
< (1, —1,0), (—1,0,1) > 
= (1, —1,0) — La CDS ao 


l(—1,0,1) II? 
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= —1)0 + 0.1 
= (1,-1,0) CDF CONES (10,1) 


1 | 11 
= (1,-1,0) +5(-10.1) = (1, -1,0) + (-5.05) 
1 i 5) 
= & "9 


, 28 Doe te 
(1-1) and lhl? = 441452 


50, w = 
= ” <u3z,U1> _ <u3,uU2> 
Now, U3 = U3 Wet tual? 
< (0,0,1), (—1,0,1) > 
= (0,0,1) „LOO 10,0 
1 1 
_ 5000-9)? E 
3 2” 2 
2 


1 101 2 = (5 1,5) 
= (0,0,1) - 5(- , 1) 3°2 3" 2 


1 1 1 1 
and||u3|I* Seto tgs 


Therefore, {(-1,0,1), (5-1, 5), 2,3) is an orthogonal basis of R? ano 


1 2/1 1 1 ft 

= —1,0,1), =(5:-1:5): 3 (5.5.5) 

g wk E 35) V3 (3-973 
is an orthonormal basis of R3. 


Solved Examples : 


1. Examine whether each of the following is an inner product on the given 
vector spaces 
(i) < (a,b), (c,d) > = ac — bd on R? 
(ii) <A,B >= tr(A + B) on M2x2(R) 
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(iii) <u> [uiv + U2V2 + U3V3|where 
u = (ty, U2, uz), V = V1, V2, V3)belongs to the vector space R3. 


Solution. 
(i This is not an inner product on R? as < (1,1), (1,1) >= 1.1 — 1.1 = 0 but 


(1,1) is not the null vector in R?. 


(ii) This is not an inner product as ford = f *) 


sA Arai A+A st p fjar- but A is not the null 


matrix in M2x2 (R). 
(ii) Let u= (uy, Uz, U3), V = (V1, Vz. V3) E Rĉand —1 E R. Then 
< (-1)u, v >= |-1 — U22 — uzv3| = juv; + Uzv2 + u3v3| 
put, (—1) < uv > = —|u,v, + Uzv + U3V3I. 
Therefore, <(-l)uvu># (—1) < u,v >. 


Hence, <,> is notan inner product. 


Let V =C[0,1] be the vector space consisting of all real valued 
continuous functions defined on [0,1] and define <,>: V XV > R 


by< f,g > = POOLS Examine whether < f,g > is an inner 
product. 
Solution. Let f,g,h E Vand c E R. Then 
1 
(i) <f. f >= f [f (t)]*dt = Oas integral of a non-negative function defined on 
[0,1] is always non-negative and< f, f > = 0 if and only if fU@yat =0 
if and only if f(t) = 0 forall t € [0,1]. 
Thus, < f,f >= 0 if and only if f is a zero function. 
li) <f.g>= KR fOgW@dt = fp g@f@dt =< g.f >. 
ba 1 
(iii) < cf, >= f Figa) = cf, f(tg(tat see fg > 
lv) <f+gh>= HIF +g OhE)dt = KIO +g@Oln@at 
1 


1 
u Í F(DA(t)dt + i POOL 
0 


0 
=<f,h> +<g,h> 


Hence, (V, <, >) isan inner product space. 
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3. Letx= (2,1 +i, i) andy = (2-i,2,1+ 2i) be vectors in C3. Compute 
< x,y >, llxll, liy] and llx + yl|.Then verify both the Cauchy Schwarz, 
inequality and the triangle inequality. 

Solution. We know, < x,y > = x171 + X272 + X3¥3 
ifx= (x1, %2,%3),Y = (Yr Y2 Y3). 
Thus, < x,y > = 2(2 +i) + (1+i)2+i(1-2i) 


=4+2i+2+2i+i+2=8+5i. 


ixl? =< x,x >= 22+ (1 +)(1- 0 +i(}i)=4+1+1+1=7 


Again, 


iyl = (@-D@+) +22+(1+2)(1-2i) = V4+1+4+1+4 =V} 


lx+ yll = 14-63 =i1+30ll | 
= (4704+ 0 + (3 -D3 +i) + (1 +3i)(1 — 3i) = V37 
Now, |< x,y >| = V87 +52 = V89 < V7V14 = V98 = |ixllllyll. 


Hence, Cauchy Schwarz’s inequality is verified. 


Clearly, V7 + V14 > V37 ie. [|x|] + Ilyll = lx + yll. 
4. Suppose u,v E V where V is an inner product space over a field F. Prove 
that< u,v > = Oifandonlyif ||u|| < ||u+av|| forall a E F. 
Solution. Let us suppose first < u,v > = 0. Then by Pythagorean theorem, we 
get, 


llu + av||? = llull? + |lav||?,  VvaeF. 


Thus, 


lu + av||? > llul? (as llav||? > 0), ie. [lull < llu + avll. 


Conversely, let|lul] < |u +avl| for alla €F. Squaring the inequality, we 
get, 
llul? < Ilu + avl? =<utav,utav> 


=< uu > +< uav> +<av u> +< av, av > 
= |lul?’+a<u,v> +a <uv>t+aa<v,v> 


= |lull? +2Re ā < uv > +laļèlivll 


-po ee Ch g 
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for alla E€ F, we get 


Thus, 
—2Rea<uv>s fal*|lvl?. 
In particular, taking a= —t <u,v >wheret >0, we have, 
2t |< u,v >|? < t? u,v >lo]? 
That is, 
2< u,v >|? <tl<u,v >[*Ilvll?[ as t > 0). 
for allt > 0. 


If v = Othen <u,v>=0. Ifv + @, taking t = Da We get, 


2|<u,v > < < uv >l? 
which is possible only when <u,v>=0. 


Hence the problem. 
Suppose u,v EV are such that |lull = 3, llu +vl| = 4, lu- vli = 6. 
Find the value of ||v|I. 


5. 


Solution. By parallelogram:law, we have, 
lu + vll? + llu — vl? = 2llull? + 2[lv|l?. 
Putting the given values, we get ||v|| = 17. 


6. Let B be a basis for a finite dimensional inner product space. Then prove 


that 
(i) If<x,z >= 0 forall z E Bthenx = 8. 


(ii) If < x,z >= < y,Zz > forall z € Bthenx = y. 


Solution. (i) Let x EV. Let £ = {Z1, Z2, ..- Zn}. Thus, there exist scalars 


C1, C2, ...,Cy Such that 
X = C121 + C22. + + CnZn 


Now, 
< X, X >= < X, C11 + C222 He FOZ, > 
=O <x > +5 <x, > ++ En < X, Zn > 
=0[as<xz>=0, ~ i= 12, .0i] 


Therefore, < x,x >= 0 which implies x = 8. 


48 GROUP THEORY & LINEAR ALGEBRA 


(ü) <4,.2>=< 714 >=> xX- y,Z >= 0 forallz E $. 


Hence, by (i), we have, x — y = 0, ie. x =y. 


7. Let (Vi Vz, Vn} be an orthogonal set in V, and let A1, A2, ., An be 


scalars. Then prove that n 


n 2 n 

2 
X aw = X lailllval 
izi izi 


Solution. We have, 


n 2 n n 


20 


i=1 


A 
a 
$ 
ig 
2 
© 
Vv 


Jaa < vavi >[as < viy >=0 fori + j] 
i=1 


n 
= Ñ lavi? 
i=1 


8. Prove that if V is an inner product space, then |< x,y >| = llxll. Ilyll if 
and only if one of the vectors x or y is a scalar multiple of other, that is, 
{x, y} is linearly dependent. 


Solution. If one of x or y is zero then both sides of the equality becomes zero and 
we can write y = Oxor x = Oy. 


Let x + 0. If y = cx for some scalar c, then 
I< x,y >| =|<x,cx >| = |Ē < x,x >] = Iclilxll? 
and}lxllllyll = Ixllllcxll = lelli? 
Thus, if y = cx we have,|< x,y >| = |ixllllyll. 
Conversely, let|< x,y >| = |IxIllllyll. 
Now, |lcx — yl? =< cx- y,cx-y> 
=< CXL, CX > -—<y,cx >< cx, y>+<y,y> 
= Ic? IIx? -¢<xyS—c < x,y > + lly? 


Ifwetake c =-=, we get 


<x,y> 
IIx]? ? 
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leny. leony SP? enya 


e 5 a ee 
x- yl? = an 
Ilex — yll Teale eal lix]? 
|< x,y >l |< x,y >|? 
“r 2s lvl? = Aa 
xl lix 


which shows that ||cx — yll = 0. In other words, cx — y = 9, that is, y = cx. 
Hence proved. 


Let V be a unitary space with dim V = n and let u E V be such that u is 


9. 
orthogonal to n linearly independent vectors of V. Then prove thatu = 8. 


Solution. Let S = {v1,V2,-+,U,} be a set of n linearly independent vectors of V, 
each member of which is orthogonal to u. Since, dim V = n, it is clear that S is a 
basis for V. Thus, there exist scalars C4, C2, .., Cn such that 


U = C1V1 + C2V2 $e + CA Vy, 
Now, < U, U > = < CyVy +CV He + Cnn U > 
= Ci S VU > +c < vU > Heet Cn <n U>’ 
= 0 [as < vu >= 0 for i = 1,2,..,n] 
Thus, < u, u > = 0 which proves that u = 8. 


10. Consider R* with the standard inner product, Let W be the subspace of 
R* consisting of all vectors which are orthogonal to both u= 
(1,0,-1,1)and v = (2,3,—1, 2). Find a basis for W. 


So'ution. Let w E Wwhere w = (x,y,z, t). Now, 

<w,u >= 0 =>< (x,y,z,t),(1,0,-1,1) > = 0 => x-z +t = 0...(1) 
and < w,v > = 0 =>< (x,y,z, t), (2,3,—1,2) >= 0 

=> 2x +3y -z + 2 = 0... (2) 
By (1),x = z — t. Putting this value of x in (2) 
2z — 2t + 3y — z + 2t = 0 => z = —3y ... (3) 

Again, x =z — t => x = —3y — t. Hence, 
w = (x,y,z, t) = (—3y — t, y, —3y, t) = y(—3,1, —3,0) + t(—1, 0,0,1), y,t ER. 

Hence, W = span {(-3,1, —3,0), (—1,0,0,1)}. 


Again, (—3,1, —3,0) and (—1,0,0,1) are linearly independent as no one is the 
scalar multiple of other. Therefore, {(—3,1, —3,0), (—1,0,0,1)} is a basis for 
Wand dim W = 2. 
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., €m} is an orthonormal list of vectors in V. Let y 


11. Suppose {€1, €2,-- k 


2 
Prove that ||vll2 = |< v, e1 >I? + |< v,ez >|" +: + |< v, em >12 S 


if and only if v € span{ey, €2, --, €m} 


Solution. By the problem the set {e1, e2, ~., €m} is linearly independent ag it; 
orthonormal. Thus, it can be extended to an orthonormal basis, Ke 


{2}, C250» €m: emis enh for V. Hence, by theorem 2.1.17, a vector v € y can 


be written as 
v =< v,e; > e1 H +< V, €m > Cmt< V, €m+1 > €m+1 +H +< v,e > e, 


and 

lvl? = |< v,e; >I? ++ |< V, em >|? + I< vest >l? +o + I< v,e, Sp 
Thus, llv? = |< v, e1 >|? ++ I< v, em >l? 

ifand only if < v,@n41 >= =< V, en >= 0 
i.e. ifand onlyif v =< v,e > ey te +< V, 8em > Cm 
ifand onlyif v € span {v4, Vz, ..., Vm} 


12. Extend the set of vectors {(2, —3, 1), (1, 2, 4)} to an orthogonal basis fo, 
the Euclidean spaceR?. 


Solution. Let v, = (2, —3,1)and v2 = (1,2,4). Let v3 = (0,0,1). Since, 


2 =9 4 
1 2 4=7#+0 
0 0 1 


we can say that {v1, v2, V3} is linearly independent in R? and hence is a basis 
for R3 as dim R? = 3. 


Now, < 14,2 >= 2.1 + (—3).2 + 1.4 = 0. So, we take another vector was | 


W = V3 — C11 — C2V2 .- 


<U3,V1> _ 1 
Iv; ll? 14 


_ <v3,v2> _ 4 
Ilva ll? 21° 


Thus, 


wherec, = and c2 


1 =) 
6’ 14 


Hence, {v1, v2, w} is an orthogonal basis for R3 which is an extension of the 
given set. 


1 4 
w= (0,0,1) z Ta 2: —3,1) — 57 2,4) = (-; y 


13. Use Gram-Schmidt process to convert the given 
{(4, 2, —2), (2, 0, 1), (1,1,0)} of the Euclidean space R3 with the 
standard inner product into an orthogonal basis. 
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tv = (1,2, —2), V2 = (2,0,1), V3 = (1,1,0). Clearly, 
ion. Le 1 
< V4,V2 >=1.2+20+ (—2).1 =0 


Gram-schmidt process, We take, 
A < v3, V2 > 


< V3,V4 > 
t =Á V 
s ia 


Sur 
llv ll? 


1+2+0 
9 


w = V3 — 


2 
= (1,1,0) = (1,2, —2) = B (1,1,0) 


1 a 
— (1,1,0) = 3 (12, —2) i 5 (1,1,0) 


21 4 1 
= (=~5,2,—)==(214 
=( EDI) is ) 
a converted orthogonal basis of R3 is given by 


Thus, f 
—(— 4 f 
{(4,2, —2), (2,0,1), 15 ( 2,1; )} 
-Schmidt process to find an orthonormal basis for the 


14. Apply Gram l i 
ace Rĉwith standard inner product that contains the vector 


Euclidean sp 


basis | 


Le 
(E-P 0). 
ion. We may take standard basis of Ras {(1,0,0), (0,1,0), (0,0,1)}. Since 
1 1 _ 4 


1 
G-n) R Z 
1 1 


v2 
by replacement theorem, we can say that (=F 


Solut 


(1,0,0) — (0,1,0) + 0(0,0,1) 


0) , (0,1,0), (0,0,1)} is a 


basis for R3. 


Now, we apply Gram-Schmidt process. 


Let v, = (=.-50). We take 


1 


1 
< (01,0), (5-4 0)>;1 1 
soam a) 
v2 (0,1,0) 1 2’ 7’ 
= (0,1,0) + =(- - 0) = (5,5,0) 
me NANT V2’ ae 


and 
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i i 
< 00 (G5) 1 o) 
pasah T A A 
vy = (0,0,1) - i 
i | 
< (0,01) (5.3.0 
T z 
2 


a oy a a 
Hence, the required orthogonal basis fork? is given by 


9.6.40) 003) 


is given by 


(- 1 
la-% 


; 3 
and corresponding orthonormal basis for R 


(4-0). (5.70) e] n 


15. Find an orthonormal basis for the row space of the matrix 


1 1 11 
A= ( 2 10) 
2 1 23 


Solution. Let us try to reduce the given matrix A to a row echelon matrix h 
applying elementary row operations on it as follows. 


eii 
A- (o 1 0—1 [Ry = R} — R}, R3 = R3 — 2R3]. 
0 -1 01 


1 0 12 
-~ (0 1 0- l [R] = Ry — Rz, R3 = Ry + R3] 
0 0 00 


whichis in echelon form whose non-zero row vectors are (1,0,1,2) ang 
(0,1,0, —1). These non-zero vectors form a basis for the row space of A. 


Let v, = (1,0,1,2). Using Gram-Schmidt process, we may take v2 as | 


< (1,0,1,2), (0,1,0, —1) > 
-2 1 
= (0,1,0,-1) — C? 0:12) = z (13.1, —1) 


Therefore, {(1,0,12),5(4,3,1,-1)} is an orthogonal basis for the row spac 
of A and the corresponding orthonormal basis for the row space of A is given by | 


J 


(1.0.12), (1,34, -1)} m 


PNE 
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y = span {(1,1,0,0),(1,1,1,2)}. Find u € U such that 
3, 4)|| is as small as possible. 


RÍ, 


£ 
z 


5. in let 
10- 
boas 


Using Gram- -Schmidt process, we get the orthonormal basis of U as 
n. 
(1 1 


a=(BRO 0), e= (0.0.=,) 


thus, the nearest point u to (1,2,3,4)is given by 
Inus: 


u =< (1,2,3,4), e, > er +< (1,2,3,4), 2 > €2 

3 3 11 22 

=(P 5'5 

the required point u for which ||u — (1.2.3.4)]| is minimum, given by 


E 3 11 2 
Ceo ol g 


=| [ on simplification] 


Hence 


1. Prove that if V is a real inner product space then 
cay > = Wet PIP = Ihe = vIP 
4 
forallu,v E V. 
2. Prove thatif Visa complex inner product space then 
ju + vil? — llu — vI? + llu + iv||7i — llu — ivi 
4 
3. Prove that in an Euclidean vector space, two vectors u and v are 
orthogonal if and only if |u + v|? = lull? + [lvl]. 
4. Show that the set of vectors {(2,—2,1),(1,2,—2),(2,1,2)}is an 
* orthogonal basis for the inner product space R? with standard inner 
product. Express (1, 2, 3) as a linear combination of the aforesaid basis. 
5. Use Gram-Schmidt process to convert the given basis 
{(1,1, 0), (0, 1, 1), (1, 0, 1)} of the Euclidean space R3 with the standard 
inner product into an orthonormal basis. 
6. Apply Gram-Schmidt process to find an orthonormal basis for the 
Euclidean space R?with A inner product that contains the 


vectors ( i -=) and (25 TE iz): 


<u,vr= 


1 

v3‘ 3" 

7. Find an orthonormal basis for the row space of the matrix 
1 1 10 

A= (2 3 11) 


1 2 31 
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2.2 ORTHOGONAL COMPLEMENTS 


Let V be an inner product space and U be a subset of V. We Wish t 
subset of V, denoted by, U+, such that each vector of U+ is orthogon fiy 
vectors of U. Formal definition given below. | al to 


2.2.1 Definition. Let V be a vector space and U CV. Define 


yi = {x E V :< x,u >=0,Vu E U}. 
Utis called the orthogonal complement of U. This may be reat 
perpendicular. as 


it is clear from the definition that if x € UŁ then x is orthogonal t 
element of U. We first show that UŁ is a subspace of V. 9 RI 


Since, <6,u >= 0 for all u € U, we have, 6 € UŁ. 

Let v,w E Utandc € F. Then for any u € U, we have, 
<cv+w,u>=c<v, u> a a i 
Therefore, cv +w E UŁ. 


Hence, U+ is a subspace of V. 


Clearly, inR?, orthogonal complement of x- axis is y - axis as 


< (a, 0), (0, b) > = a.0 + 0.b = 0 and orthogonal complement of the line y= 
is y = —x as < (a,a), (b, —b) >= ab — ab = 0. J=] 


Similarly, in R?, orthogonal complement of x - axis is yz plane and vice vers 


as any point on x — axis can be taken as (a, 0,0) and any point on yz plane cank 
taken as (0, b, c) and we have, 


< (a,0,0),(0,b,c) >=a.0+0.b+0.c=0 


Example.In Euclidean space IR* with standard inner product, let Wbe th 
subspace generated by the vectors (1,0, —1, —4)and (0,1,1,2). What is WŁ? 


Let vı = (1,0,-1,—-4), vz = (0,1,1,2)and W = L{v4, v2}. 
Let u = (a,b,c,d) E WŁ}. Then 
<u, v, >=0=>a—c—4d=0...(1) 
And < uv >=0=>b+c+ 2d = 0... (2) 
By (1)and (2), we have, 


(a,b,c,d) = (c + 4d, —c — 2d, c, d) = c(1, —1,1,0) + d (4, —2,0,1),c,d ER 
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1 = span { 1, 1,1,0 J i, 2,0,1 } 
Hence, w C i ) f 


aie now study some basic properties of orthogonal complements 


2 Theorem: fS cTthen S*> TŁ. 
2.2. 


L = 
proof. Let x E T+. Then <x,t>=0 foraleT. 


une es > = 0 forall s € Sas S CT. Therefore, x € s+. 


L 
Hence, s+ 2 T . 


2.2.3 Theorem. If S and T are subspaces, then (S+T)t =S!nT!. 


proof. since, 5 = S +T, we have, (S +T)* c S+. Similarly, (S+T)* c T+. 


Therefore, (S+ T+ es* n TŁ, 


Let x ES” nTŁ. Then < x,s >=0,Vs E Sand < x,t > = 0, Yt ET. 
Let y ES +T. Then y = s + t for some s € Sand t ET. 
Now, <2 PP SK Ueto SAGs > +<x,t>=04+0=0 


so, xES+ T)* as y is arbitrary. 
therefore, St NT* CGS +T}. 


Hence, (S +T) = S+ n T+ (proved). 


it should be mentioned here that if U1, U2 are subspaces of V, then V is the 
direct sum of U, and Uz (written V = U, © U2) if each element of V can be 
written in exactly one wey as a vector in U} plus a vector in Uz. The next theorem 
shows that every subspace of an inner-product space leads to a natural direct sum 
decomposition of the whole space. 
2.2.4 Theorem. Let U be a vector subspace of an inner product space V. 
ThenV = U @ UŁ. That is, any x E V is of the form x = u +w withu € U 
and u € U+ and this decomposition is unique. : 


Proof. Let us consider an orthonormal basis of Uas (u1, Uz.. Ur}. Let x € V. Let 
us define 


u = < xX, > Uyt< X, Uz > U2 t z He Su EU 


Let u =x-w. 


Then < U , UR >= X uU, Ug > =< X, Uk > TS UU > 


k 
=< X, Up, >-<) <n > Uj Uk > 
i=1 


. BRA 
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k 
=<X%,uU, > =) <xum><usys 
i=l 
=< X,U; > — < X,U; > | 
(as < Up Ug PENS eena caan 


=0 
Therefore, u’ is orthogonal to each uzfor k = 1,2,..,r. 
let wEU. Then W = CiU; + CU +e- + Gu, where GEF for 
1,2,..,7. Now, = 
<u wo=< u Cith + Guz +- + Cri, > 


=G <u, > +0 < uuz P a eater e u, u, 5 
=O(as <u,u, >= 0 for k = 1,2,..,r) 
Thus, u’ is orthogonal to each element of U, in other words, “ue Ut. 
Hence, x =u +u whereu € Vand u E U+. 


To prove the uniqueness, let x=ut u = q+qg' where u qEU 
, 2 


u,g €U+.Then tf 
u—q =q -i 
Since U and U+ both are subspaces, we have, u — g E Vand q -u g€ yt 
f, z=u—q=q —u'then zE UN U+. But Un U+ = {9} as 8 is the ony 


vector which is orthogonal to itself. Hence, z = 6, that is, u = q,u = g. 
Thus the decomposition z =u +u, u EU, u E Utis unigue. 
Hence, V =U Q Utm 


2.2.5 con : If U is a subspace of an inner product space V, then U= 
0y. l 7 
Proof. Let u EU. Then <u,v >= 0 for all v E€ UŁ. Thus u is orthogonal to aff 
vectors of U~. Therefore, u € (U+)+. Hence, UC j+)t. 
Now, let v E (UJE. 


Then v E V and we can write y = u+w where u EU,w E€ UŁ. 
But u €U =>ueE(yu+)t (already proved). Therefore, 


A E 4 g f > 
t £ ) „u E(U+)}t and (U+)* is a subspace, together imply v — u € (U*)* 
means that v — u is orthogonal to itself. This implies v — u = 8, in other — 
words, v = u € U. Thus, (Ut cy. Tn 


Hence, U = (U+)ig 


linear Algebra i 57 


ne expression x= u +u where uEU and u €U* is celled the 
note? i ; decomposition of the vector x with respect to U. The inner product 
ogon? apa orthogonal direct sum ofU and U+. What happens if we 


ca! 
nap Pr? y — Uby Py(x) = u ? Let's come to the following definition. 
ane 2 


gnition. Let U be a vector subspace of an inner product space V 
226 eer Then the orthogonal projection Pyof V onto U is the 
and r — ywherex =U +u such thatu € U, andu € U+. 

p, = 
mapt U oof of theorem 2.2.4, an expression of Py in terms of an 


I fact, in the pr $ 
n basis of U has already been introduced. If {uz,u2,-..,u,} is an 


asis of U, then 


< XU, > UEL K,U > Ug t-- $< 4,u, > i 


orthonormal 
orthonormal b 
Py) =u = 
Geometrically, the orthogonal projection of x onto U is the foot of the 

r drawn from xto U. What about x-—u? x-u=u €+. 


endicula - 
perp the orthogonal projection of x intoU+. 


thus. — Y is 

22.7 Theorem. Let W be a vector subspace of a finite dimensional inner 
product space V. Let {4,W2,---,W,} be an orthonormal basis of IV. Let 
fy, U2, .,Us} be an orthonormal basis of 
{iwp Woe =s Wri Un Urs =s u,} is an orthonormal basis of V. 


W+.Then 


Solution. Since norm of each element of {17;, W2, -.., Wr, Uz, Uz, --,-U;} is Land 

< Wp > =< Up > =< Ww, >= 0 fori+j 
we see that the set {Wi Wa, o-s Wy, Uy, U2, ...,U-} is orthonormal and hence is 
linearly independent. 

Let v EV. Then ve=ws wwhere w EW, w E W+. Since {Wi Was Wr} 
and {u1 Uz, Us} are bases of W and W+ respectively, there exist scalars 
C4, Cz, -+s Crs dy, dz,,,ds such that 

vow+tw =C W + CW +--+, + dyu, + dzu +--+ du, 

Thus,v E L{wy, W2, -s Wrs Uy, Uz, --, Us}. 

Hence, {Ww ,W2,...,W,,Uy,Uz, -.-,Us} is a basis ofV m 
2.2.8 Theorem. Let S be a subset of an inner product space V, and W = L(S). 

Then S+ = Wt. 


Proof. If S = Ø, then W = {6} and hence, S+ = V = WŁ. So, let S + Ø. 
Now, S E W => WŁ g Sh. 


So, let s € S+, Letw EW. 
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Since, L(S)=W, there exist 51,5z,--.5, ES and scalars cy,c,,, 
that iv = cS; + 252 +--+GSn ‘Ca 
Now, < ws Se QS F C257 t + e pe 


“ey 


= C; < 53,5 > +¢€2 < 52,58 or ec SS > 


=0[< gS >= 0 fort = 1,2,7 ass € S+) 


Therefore, s E WŁ. In other words, S+ S WH. 


Hence, S+=W+m 

Now, we may discuss a problem: given a subspace U of V and a point p 
find a point u € U such that {Jv — uf] is as small as possible. The next the S 
shows that this minimization problem is solved by taking u = Py (v). toren 


2.2.9 Theorem. Suppose U is a subspace of an inner product space y and 
Then {lv — Py{v){] < ljo — ujil, Yu EU ve 
Furthermore, if u € U and the inequality above is an equali 

ty, 
Po(v). ven 

Proof. Letv EV. Thenv =x +x wherex EU and x EU. 

Thus, Py(v) =x. Therefore, v—Py(v) =v—-x=x EU+ andP,(v) 

U for all u €U. of 

Hence, foranyuEU, we have, <v—Py(v), Py(v) -u >= 0. Ther f 
by Pythagorean theorem, üi 
ilv — Pu ii? + HPy (o) — ull? = fle — Py (ve) + Py(v) — ull? = liv — yy 
Thus, {jv —ufl? > ilv- Py. 
Hence, flv —Py(v)i] < [lvu—ul] forallu €U. 
Clearty, equality holds if and only if 
iv — Py (v) fl? + fiPy(v) — ull? = flv — ull which occurs if and only if {|Py(p) 
uji = 0 if and only if Py (v) — u = 8 if and only if Py (v) = um. Sl 
What is the geometrical interpretation of Py ? 1f v E V then P,(v) € U is the 
unique element of U which is nearest to v as [lv — Pw) < flv —ulf s 
ailu € U. n 


y, 


~ue 


2.2.10 Bessel’s Inequality : Let V be an inner product space, and letS = 
{uz, Uz, -~ Un} be an orthonormal subset of V. Prove that for anyx EV 


vic X, U; >|? 


i=} 


fxj? = 
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proof. Let 

ror any, FE (12, 
we Haver 

ex utj > =< xXx, uy > 

< (< X,U; > U; +< x, Uz >u, te < xu, ES 
s nJ, Uj 
= Ofori + jand < uj,uj >=0 
sui is 
thus, Yj E (x —u)?* for allj = 1,2,...,n 
Since: u)" ea subspace; weave, 
u =< x, uy > Uyt< Xz > U2 +- <x,u, > Up E (x— u)! 

Thus, X= (x-u)+u where <x-uu>=0. So, by Pythagorean 

theorem, 


wat}? = lix — ull? + lull? 


which implies that xl? = llull? Cas Ix — ull? > 0) 
Le. 
n 
Ix? > X< xu >l 
i=l 
Hence the result. 


Note: Bessel’s inequality becomes an equality if and only ||x — u|| = 0, that is, if 


and only if 


Solved Examples = 


1. Suppose U is a subspace of V. Prove that U+ = {0} if and only if U = V. 


x = u E L(S). 


Solution. Since U is a subspace of V, 
we have, V = U @U+ 
Thus, U+ = {89} if and onlyif V =U. 
2. Let S= {(1.0,0), (1,2, 1)}in C3. Compute $+. 
Solution. Let (a,b,c) E S*. 
Then < (a,b,c), (1,0,0) > = 0 => a — ci =0.....(1) 
And< (a,b,c). (1,2,1) >= 0 => a + 2b +c = 0... (ii) 
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By (i), a = ci. Using it in (ii), 
1 1 : 
we get b= -z(a + c)=—-5 c(1 +i). 
Hence, 
c , „1 : 
(a, b,c) = Ca + i), c) = ce(i-50 + i),1) CER. 
5 nail ; 
Hence, S+ = span ((i-30 + i),1)}. 
3. Find the orthogonal complement of the row space of the matrix 
1 2 10 
A= (1 3 22}. 


0 1 12 


Solution. Let us apply elementary row operations on A to bring it to row reduceg | 


form as follows : 


i 2 wW . 
a= (0 1 12 IR; = Re — R 


0 1 12 


1 0 -1-4\ | 
~(c 1 1 2 [Ry = Rı — 2R2,R3 = R3 — 2R] 
0 0 00 


Let vı = (1,0,—1,4) and vz = (0,1,1,2). Then the row space of A is given by 
W = span {v;, v2}. 
Let u = (a,b,c,d) E WŁ. 
Then < u, v, > = 0 => a —c — 4d = 0... (1) 
and< u, v2 > = 0 => b +c + 2d = 0 ... (2) 
By (1) and (2), we have, 
(a,b,c,d) = (c + 4d, —c — 2d, c,d) = c(1, —1,1,0) + d(4, —2,0,1), 
Therefore, W+ = span {(1, —1,1,0), (4, —2,0,1)}. 


Hence the orthogonal complement of the row space of A is given by 
span {(1, —1,1,0), (4, —2,0,1)}. 


4. 


CAER 


Let A be a real m x n matrix. Show that the solution space of the system 
of the equations AX = 0 is the orthogonal complement of the row space 
of A in the Euclidean space R” with standard inner product. 


Solution. Let A = (aij Ja xn PE a real matrix and R}, R2,...,Rm be the row vectors 
of A where 


R; = (aii, Qi2, eee Gig); S12, anni 
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the row space of Aisgivenby R= L{Ry, Ro, let 
en 


Th 
Let 


n space of AX = 0, that is, 
W = {S E€ R” : AS = 0}. 
Sn) E W. ThendAS = 0, that is, 


w be the solutio 


= (Sp S2: 


tet 5 l 
i151 + Aj252 pe AinSn = 0,i = lZ tis 


nus Sis orthogonal to each R; fori = 1,2,..,m. Hence, S E R+. 
Thu 

1 
Therefore, Wek. 


versely, let U = (uj, Uz, --uUn) E Rt. Then U is orthogonal to each Ri 
con f 


fori = 1,2, «+, m 
Thus, arts + 22 ee ee ae 
+ 


Therefore, U e W. Inother words, Rè? CW. 


Hence W= R+, that is, the solution space of the system AX =0 is the 
snd complement of the row space of A. 
or 


Let ff be a basis for a subspace W of a finite dimensional inner product 
space V, and letz E V. Prove thatz € W'+if and only if < z,v >= 0 for 
every v E B. 

Solution. Since B ìs a basis forW , so, vEß,zE ae ae eee eee 
the condition is necessary. 


5. 


Conversely, let <z,v>=0 for all v € B. We shall show that ze W+. 
Let B = {V1 Vz- Vg}. Let w E W. Then there exist scalars C4, C2, -., Cy such 
that 
Ww = CV, ECU Fee ++ CUR 
Now, < ZW >= < Z, CV; T CVa +--+ CRVE > 


=i < Z0 > t<> +--+ cL > 
=0 [as <z,v >=0YvEf]. 
Hence, z E WŁ. 


6. Find the orthogonal projection of the vector u = (2,6) on the subspace 
W = {(x,y) : y = 4x} of the vector space R? with standard inner 
product. 

Solution. Here, W = { x(1,4) : x € R} = L{(1,4)}. Thus, kasi for W is given by 
{(1,4)}. Therefore, an orthonormal basis for W is given by e = 5 (1,4). 


6 o 
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Hence, the projection of u on W is given by existence of T* for a given linear operator T on V. 


1 % 7 may doubt m B 
<we >e =< (2,6), — (1,4) > 1 on twill he'p ~>- 
ds ’ = — ' su 7 2 
‘ ati ) aS (2,6), (1,4) > Ta (1,4) çoloviné re y be a finite dimensional inner product space over a field F 
= = (1,4) ad theore™: ‘i F be a linear functional. Then there exists a unique vector 
, . r 1, e! : = 
and let J ~<x,y>forallx EV. 
Exercise yE y such that on A h | basis of V, and let 
be an orthonormal bas! ’ 
= (vy, V2 Un) 
1. Find the orthogonal complement of the row space of the matrix proof. tet B {vı n 
1 1 2 = > (vi) vi 
a-(2 3 s); a 
347 á 
2. Let W = span {(i, 0, 1)}in C3. Find orthonormal bases for W and w: tet us define h:V >F by h(x) =< x,y >. Clearly, h is linear. Now, 
3. Let W and W3 be subspaces of a finite- dimensional i : . 
nner prod z aluin = ,. : 
space. Prove that (Wi re Ww.) = wi n wł and VA nW yu i hy n(v;) =< Vj Y >= y, 2 9) v; >= X svd < Uj, vi > 
wł. ae i=l i=l 
4. Find the orthogonal projection of the vector u = (2,1,3) on the = g(vy) < yj vi > +92) < Yj vz > te + g(y;) < Vj Vj 
subspaceW = {(x, y, z) : x + 3y — 2z = 0} of the vector space R3 with > tort gn) < jih > 
standard inner product. 


= g(v;)[ as < vyj, v; >= 0 for i + jand < vj, y >= 1] 
2.3 ADJOINT OF A LINEAR OPERATOR AND ITS BASIC PROPERTIES 


So, h(v;) = g(vj) for j =1,2,..,n and hence, h(x) = g(x) for all x EV. 
We know that if V be a vector space over a field F then a mapping T: V >y Thus, h=g. 
is called a Linear operator on V if for all x,y € V and for all c € F 


(i) Tæ +y) = TX) + TO) and To show the uniqueness of y, let g(x) = < x,y > for some y ev and forall 


x€V. Then forx EV, 

(ii) T(cx) = cT@) 
or, equivalently T(cx + y) = cT(x) + TQ). iia gQ) =< x,y >=<x,y > 
Properties of linear operators are discussed in detail in my book Ring Theory i rue forall x € V, we have, y = y’. 

and Linear Algebra. Readers are advised to go through that book if they need any ence proved, 


support. Here we study some advanced part of it. In addition, we must take into 


235 Example : Let V = R3 
account the linear functional which is defined as a linear mapping f : V> 


,d : 
Nant to find a vector v EV iil e a g(x,y, z) =x — 2y + 4z. We 


i he such that g(u) = < 
where V is a vector space over a field F. For example, for some fixed Aa We know, ins ae ) u,v > foralu ev. 
: ‘ ; i inte | ane onormal basi 
mapping f : V > F by f(x) =< x,y > isa linear functional. It is very ie asis of R? where 


. à . : t F is = 
that if V is finite dimensional then every linear functional from V into | , e1 = (1,0,0), e; = Gites bee 
form. Theorem 2.3.4 will support it. | , gle) = 7 


(e) = 


=2, gle3) = 4. W 
Let’s start with the following definition. atake 


| v = glee, + 
2.3.1 Definition. Let T be a linear operator on an inner product p a | ai 1 + ger)e2 + g(ez)ez 
we say that T has an adjoint on V if there exists a linear operator | (1,0,0) + (— 


"S, foranyu = 2)(0,1,0) + 4(0,0,1) = (4, -2, 4) 
that < T(x), y > = < x, T* Q) >for allx and yin V. aa 


z) E V, we have 
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atu) =< u,v 


> =< (x,y. z).(1,—2,4) sa linear operator 
selj h -2,4) >x oin of a linear P 
Let's come to the im X—2Y¥ +42 q aies of the adj ; : i 
portant theorem. oat pe be a finite dimensional inner product space over a field ; 
2.3 e 
S Theorem. Let V be a finite di ionali sreore™ Let V - erators on V, and a E F. Then 
TN imensional inner Product spa 33) pe two linear OP 
P ron V. Then there exists a uni r ce and let and T 
that < Tx), y >= que function Te T be 5 ey i 
ss «y >=<x,T (y) >for all x,y € V. Furtherm Va n q PART Ei 
oof. Let y Ore, T; np ®i = 
: lety EV. Define g : V > F by g(x) =< T(x), y > T IS lines, 0 YaTT 
ow that g is linear. Let :y > for all ` ) 


T 
X%1,X2 E V and c E F. Then = SY, We fir P 


g(cx, +x) =< Tex, + X2),y > 


2 proof? 
=< cT (x 
G4) +T), y > Las T is lineg i etay EY sapt 0> 
=c <T), y> +< areae 
dy> p Oe E 
= cg(x1) + g(x2) =><T'(y), % >= <y, 
Hence, g is linear. want SAT OF 
r by theorem 2.3.4 there exists a unique vector y'iny =>< T(x) y > =< Tey > 
g(x) =< x,y >.in other words, g(x) =< T(x), y >=< Ay Se SUCH that p eT 
Let us define T” : V > V by T'O) = y’, thatis, < T(x), y >= <x T Hence, TO) =T C) l 
Now, we show that T” is linear. i 0)> therefore, T = i a 
Le 
t ¥1,¥2 EV andc EF. Then for x E V, we have, (i) etx yE V. 
<x,T*(cy; + y2) > now, <x (S+T)'O) > =< (S+T)(x),y > 
=< T(x), cy; + y2 > =< S(x) + T(x),y > 
= č < T(x), yı > +< T(x), y2 > =< S(x), y > +< T(x), y > 
=< x, T 1) > +<x,T’ (C2) > =< x,S*(y) > +< x,T*O) > 
=< x, cT (y1) > +< x,T' OR) > =< x,S* (y) + T* (y) > 
=< x, cT" (y1) + T* 2) > =<x,(S'+T")Q) > 
Since, x is arbitrary, we have, T*(cy; + y2) = cT* (y1) + T* (y2). Therefore, Hence, (S +T)*O) = (S* + T*) O) forall y € V. 
T“ is linear. Therefore, (S + T)* = S* +T*. 
To prove the uniqueness of T*, let S : V > V be such that for all x,y E€ V (iii) Forx,y EV, 


<T), y > = <x, SQ) > 
Thus, < x,S(y) >= < x, T*(y) > forall x,y E V which shows that S =T". 
Hence the theorem m 


we have, < x, (aT)*(y) > = < aT(x),y > 
=a< T(x),y > 


=a < x.T*(y) >= < x,āT*(y) > 
So, (aT)* (y) = aT*(y) for ally € V. 


Hence, (aT)* = ar’. 


z P rator 
The linear operator T* used in the above theorem is the adjointof the apa 
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(iv) Forx,y eV, 
we have, < x, (ST)"(y) >=< ST(x),y> 


=<S(T@)),y> 
=< T(x), 5° ty) > 
=< x,(T°S*)(y) > 


Thus, (ST)*(y) = T"S*(y) for ally e V, 
Hence, (ST)* = T°S* as 


The next result shows the relationship between the nulls 
linear operator anditsadjoint. But before that | think it is 
definitions of null Space and range of a linear operator. 


Pace and therangeof, 
better to recap the 


If T: V > V bea linear operator where V is a vector space Over a fi 
null space of T or kernel of T, denoted by null T or kerT, is defined as 


null T =kerT = {v E€ V : T(v) = 6} 


eld F then 


and T(V) = {wEV :3v EV such that T(v) = w} is known as range of T. 
Thesymbol< => means‘“ifand only if”; this symbol could also be read to Mean 
“is equivalent to”. 
2.3.8 Theorem. Let T : V > V bea linear operator, V being an inner Product 
space over a field F, then 
(i) null T* = (rangeT)* 
(ii) range T* = (nullT)+ 
(ii) null T = (range T*)+ 
(iii) range T = (null T*)+ 
Proof. 
(i) LetwevV. 


Then w E null T° 
<=> T*(w)=80 
<=>< v,T*(w)>=0WvEV 
<=><T(v)w>=0,WweEV 


<=> w E (rangeT)! 


Hence, null T* = (range T)+. . 
(ii) If we replace T by T° in (i), and use (T*)* =T, we get, 
null T = (range T*)* 
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plement on both sides, we get 
om 


onal c = 
rang orth? ge T = (null T) [as (A+) = Al 
ran 


ed in (ii) 


; ts on both sides 
i hogonal complemen 
+ = (range T)*. Taking orthog 


ready P'O” 


e r 
A perator 7 defined on an inner product space Vove a 
on. 


ee ‘oint (orHermitian) if T” = T. 


eore . 


ant T be two linear operators on V then D ee 
grt invertible then T“ is invertible and (T*) n 
i Sand T are self adjoint then S + T is also self adjoint f 
g If adjoint then ST is self adjoint if and only if ST = TS 
(ii) IfS andT are se ER 
(iv) For any a E F and for any self aa) 


and only if a is real. 


Proof. P 
(i) Since, T is invertible, we have, TT-! =] = TIT. Then by theorem 2.3.7, 


(TT!) =I" =1 => (T)'T* =I 
Similarly, T*(T~*)* = I. 
Hence, T“ is invertible and (T*)~! = (T~1)*. 
(i) Since S,T are self adjoint operators, we have, S* = Sand T* =T. 
By theorem 2.3.7, (S+T)*'=S*+T*=S+4T. 
Hence, S +T is self adjoint. 
li) Wehave, S*=§ T* =T. By theorem 2.3.7 
(ST) =ST <=>T'S* =ST <=> TS =ST. 
Hence, ST is self adjoint if and only ifST=TS. 


sh @€F and T be a self adjoint operator i.e. T* =T. Now, by theorem 


Jf, 


aT) = sate ape _ 
(aT) al <=> aT sas SST S0T €=> Reg <=> ais real 


Hence Proved. 


x 


Solved example : 


1. L 
ae be an inner Product spac 
: near functional T: y © over the field F, Fix a y 
Ormula for T* (a) >F by Tw) = Sn ector v e A 
Solution ee Fir aise poh 
see th ` It is clear that 7 is a ma "Ang 
! 
at (6) is a uniata ve ee no OP Thos toga 
<T(u) ctor in V such that ra fixed ag F 
,a = * 
The loner g a Su,T"(a) >foralluey (1) = 
Aerea a... an 
product on the Cae age right is the inner Product defineg 
Stier Intef the usual inner product def ed in V, but the 
e first slot with the compl ined on F; the pr inne, 
Thus, plex conjugate of the entry in th Put of the 
e secong 
sl 


n < T(u) a >= [Tu= <uvs a 
sing (1) and (2), we can say that 
l <u, T (a) >=<u,av> 
for alu €V. Hence, we have, T*(a) = av m 


=< uav >... (2) 


2. ae be a fixed si integer. Define T € L(F") by T(z 
“a: 1/22,.+,Zn—1) find a formula for T* (zy, z3, seg Zn): aa 
Solution. Let us fix (21,Z2,..,Z,). Then for each (W1,W2,..,Wa), Weh 
< (Wi, W2, .., Wn), T* (24, Z2., Zn) > _ i 
= < T(W,W2,..,W,), (Zi Z2., Zn) > 
= < (0, W1, Wz,- Wn—1), (Z1, Z2, .., Zn) > 
= W12 + W2Z3 + +++ + Wn-1Zn + Wn.0 
=< (W1, Wass) Wn), (Z2, Z3, =, Zn, 0) > 


Hence, we have, T* (Z1, Z2,.-., Zn) = (Z2, Z3, ...,Zn,0)m 


3. Suppose T € L(V) and åA E F. Prove that A is an eigenvalue of T if and 
only if A is an eigenvalue of T”. 


Solution. We have, A is an eigenvalue of T 
& T — AI is invertible there exists S E L(V), 


such that S(T — AI) = (T — ADS = 1 & (T -AD'*S* = S*(T -AN =1 
[as (UV)* = V*U*,Y U,V ELV] 


> (T — AI)" is invertible 
& T* — ÀI is invertible 
«> Lis an eigenvalue of T’. 


Hence, the result. 
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a subspace of V. Prove that U is invariant 
S 


Ui : 
and tunderT . 


rer „e 1+ is invarian 
s yifU ; 
sup?” y ifand OP -iant under T, that is, for u € U, we have, 
L derf! į y is invarian 7 
| first 
l i EU. 
“ie y Pe E i tora , pepa 
pé a as i r'(v) E yt, in other words, <u,T (v) >= or a 
F tha 
il how h 
ow, 2 vy >= 0 [asT(u) EU]. 
Ti curo) 2 =< 7M 


Ts 


yt is invariant under T*. 


is invariant under T*. Th ie 
y is invariant under T as (U+)- = 


en by the first part, (U+)Ł is 
U and(T*)* = 


Hencer 

y+ 
sely, let j 
conve" der TY, atts 


ve that (a) T is injective if and only if T* is 


E L V, wW). Pro i 
ose TER tive if and only if T* is injective. 


F nd (b) T is surjec 


surjective a 


Solution. (a) clearly, 
T is injective © null T = {0} 


& (range T*)* = {0} 
& range T* = W 
& T* is surjective. 


(b) In (a) replace T by T” and use the fact P ST, 


6. Prove that 
dim null T* = dim null T + dimW — dim V 


and 
dim range T* = dim range T 
for every T € L(V, W). 


Solution, Let T € L(V,W). 
Then 


dimnull T* = dim(range T)+ 
= dim W — dim(range T) 
lasdim(range T) + dim(rangeT)* = dim W] 
= dim null T + dim W — dimy 
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. by Sylvester's law, dimnull T + dim range T = dim v] 


To prove the last part, we have 
t 
dim(range T*) = dim W — dim(null Ty 


= dim V —dim(null TI by 1st pa 
rt 


= dim(range T) l 
Hence proved. 


Exercise 


1. Let V be the space C?, ~ 


with standard inner produ 
operator defined by ct. Let T be the linea, 


Te, = (1, —2), Tez = (i,-1). lfv= (X4,X2), find T’v 


Let T be a linear operator on C? defined by Tey = (14; 
(i, i). Using the standard inner Product, find the matrix ats 
standard ordered basis. Does T commute with T"? T ith 


Let V be a finite dimensional inner product space and T a linear op 

. . ` er 
on V. If T is invertible, show that T° is invertible and (T*)-1 = ry 
Let V be an inner product space and B, y fixed vectors in y, Show that 
T(a) =< a,B > y defines a linear operator on V. Show that T has an 
adjoint, and describe T* explicitly. 


5. Show that the product of two self-adjoint operators is self-adjoint if and 


only if the two operators commute. 


6. Let V be a finite dimensional complex inner product space, and let T be 


a linear operator on V. Prove that T is self-adjoint if and only if 
< Tv,v >is real for each v E V. 


2.4  BILINEAR AND QUADRATIC FORMS 


So far, we have studied linear functionals whose domain is V, a vector space over 
a field F, and codomain is F satisfying linear properties. Now, we shall study those 
functions which are defined on V x V and have codomain as F satisfying some 
properties described below. 


; yxy- 
2.4.1 Definition. Let V be a vector space over a field F. A function f : V X 


is called a bilinear form on V if 
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y €VandceF 


1l x X2 
4. (x2, y)for a Ay 
a eVandde rs 


s+ fare all x, Y1: Y2 
Ji 


i ‘able when the other variable is 
if s/f “ y if f is linear in each varia 
(i 


i B(V). 
fis biline? m set of all bilinear forms on Vby B(V) 
qus: denote 
g. We 


duct space that is, a Euclidean space, thenf:V XV > 
uc ’ 


e ' 
0 ' 
eal inner P’ > isa bilinear functional. 


2 
r 
g defined by fC „c Vand c € R, we have, 


Xn) 
gi < xy FEY > ESA 7 tliy > 


=<c 
pra pce tF) 
e Vand d E R, we have, 


clearly: 


” jacuit? 
f (x,dy +92 a 
= d oxy >r<%y2 
= df (x, Yi) + f(x, y2) 
Therefore, f is bilinear. 
itis clear that f, as defined above is not bilinear if the underlying field F is 
Note : " 


ronplexasin that case d will come instead of d. 


2 let V=F", where the vectors are considered as column vectors. For 
| anyA E Maxn(F){ that is, for an n X n matrix A whose entries are from F ], 
define f : V X V > F by 


f(xy) =x'Ay, forx,y EV. 


look, here`x and y are nX 1 matrices and A is ann Xn matrix. Thus, 
f(x,y) =x" Ay isa 1x 1 matrix, that is, a scalar, a member of F. 


Now, for x1, x2, € Vande E F, we have, 
flax + x2,y) = (axı + x2) Ay = (ax! + xb)Ay 
= axjAy + xhAy = af (x,y) + f(xy) 
Again, forx, y4, Yz € V and ford € F, we have, 
X, = 
fdy +y) = x'A(dyı + y2) 
= dx'Ay, + x" Ay, 


= AF (91) + fya) 
ence, fisa bilinear form onV m 


eee i OCR 


thenL, and Rx are linear. 
im f(@,x) = f(x, @) = Ofor all x EV. 
(iii) For all XY,Z,WEV 

f@+y,z+w) = f(x,z) + f(x 


(iv) If 9:*VXV >F is define 
form. 


w) +fO,2)+ Fry 
d by g(x,y) = f(y,x), "9 


Proof. 


(i) For Yı y2 E V and ford E F, we have, 
Lx(dy1 + y2) = f(x, dy, + y2) 
=d fy) + f(x,y) [ 
= d Ly (91) +L, (y2) 


Therefore, Ly is linear. Similarly, 


as f is bilinear ] 


it can be proved that R, is linear 


(ii) For any v EV, we have, @ = 0.v and hence for any x E V, we h 
, ave, 


f@, x) = f(0.v,x) = 0f (v,x) =9 
Similarly, f(x, 0) = 0. 


(iii) For x, y,z,w € F, we have, 


f +y,z +w) = f(x,z+w) + f(y,z+w) 
= f(x,z) + f(x,w) + f(y,z) + £0,w) 
(iv) Since f is bilinear on V, for X4,X2,y E V and c E F, we have, 
g(cx, +x2,y) = f(y, cx, + x2) 

= cf, %1) + f(,x2) 
= c g(%⁄1y) + g(x2,y) 

Similarly, forx, y1, y2 E V, d E F, we have, 

g(x, dyi + y2) = f (dy, + yz, x) = df (x) + f 92x) 

= dg(x, yı) + g(x, y2) 


Hence, g is a bilinear form on V. 


` . 1 
d i hen yh 2 (uy 22" orm defin 


then g; 
g 'S a biting, pap 
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-ofa bilinear form 


tion i a V 
ep! sent an ordered basis of n 
prit" #,) Bf ed on V. Then, we Ca 


ood 


ector space V over a field F 
associate with fannxn 


“line?! -< defined by 
i inet ere S p jabon 
J a (aij xn ss (vj) Vv; , , i w siie 
he Sakae -on of f with respec 
“att aij iss sie matrix representation O f 
is ca 
b 
nem? Late denoted bY¥B n E ( n, 
pd bas mpn ( Jand y =\y, 
nig 2 where X2 E) 0%) l 
Let % one 
x, y) =<xuy X2 y2 
P 7 Roy f 
ud = x41 + X2Y2 
1 0 
: 2 = i e2 = . 
} be standard ordered basis of R where €1 (5) () 
= (e4, 2 
tet B= {er 


ix A = (ay), matrix with f with respect to B, 
ish to associate a matrix A = (tij Jox2 
We wi 


wee Ze (4). (9) EENE 


PE a a 


m=<(1)G) >= 


| Hence, the matrix representation of f with respect to the ordered basis B is given 


by 
1 0j 
W= 4)" 
25 SYMMETRIC BILINEAR FORMS 


25.1 Definition. A bilinear form f on a vector space V is a symmetric bilinear 
form if f(x,y) = f(y, x) for all x,y E€ V. 


As the name suggests, matrix associated with a symmetric bilinear form is 
Symmetric, follows from the following theorem. 


2.5.2 ene 
Theorem. Let f be a bilinear form on a finite dimensional vector space V 


and let B be an ordered basi , i ; 
asis for V. If 
symmetric, f is symmetric thene (f) is 


Proof, Let B = {v, 
10 


V2i +., Vn} be an ordered basis for Vand A= pg(f). 
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Thus, A = (ai; ) „where az = f@uy). 


If f is symmetric then f(x,y) = f(y, x) for all XY EV. Th 
- Ther 


Gij = f(va y) = f(u, v) = a, 


Hence, A is symmetricm 


efore, 
ij € {1,2, ~an} 


2.5.3 Definition. A bilinear form f on a fi 
x” called diagonalisableif there is an ord 
a diagonal matrix. 


nte dimensional Vector 
ered basis ii 
B fory SUCH that a Vi 
BIA. 
a i 
2.5.4 Definition. Let A, B € Myxn(F). Then B is said to 


be con 
exists an invertible matrix Q € Mp xn (F) such that B = gt uent to A i the; 


ae AQ. 
The question is how can you relate congruence to the matrix r, 
a bilinear form? Answer lies in the next theorem. epr €sentation 


2.5.5 Theorem. Let V be a finite dimensional vect 


or space with 
B = [vi v, ser and y= {wi W2, 


Orde 
Wn} and let Q be red base 


: A e t 

coordinate matrix changing y —coordinates into B itd s change of 

any bilinear form fon V, the matrix Y, (f) is congruent to y in Then foy 
S B é | 


Proof. Let A = We (f)and B = Wy (Ff). Since, w; E€ V and P is an ordered basis for 
V, there exists scalars Q1;, Q2;, ...,Q,; such that | 


n 
Wi = Qiii + Qoi¥2 ++ Qni vi = >. Qki Yk 
k=1 


Similarly, we have, 


n 
Wj = > Q,; Vr 
r=1 


Then, Bi = fi, w) = TEka Qki Vk, w) 


= y Qrif Vk Wj) 
k=1 

= 5 ufo Qrj Yr) 
k=1 r=1 

= z Qki 5 Qrj f Wr: Yr) 
k=1 r=1 
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n n 
= > Qki p3 Qrj Akr 
k=l r=l 
n n 
= y, Qki >, Akr Qrj 
k=1 r=1 


= ` Qki (AQ)kj 
k=1 
= >, Qin (AQ) kj 


k=1 
= (Q'AQ) ij 


Therefore, B = Q'AQ 

Hence, B is congruent to A, that is, Y, (f) is congruent to vC). 

Now, we shall state a theorem without proof (beyond the scope of the 
syllabus) 


2.5.6 Theorem. Let V be a finite dimensional vector space over a field not of 
characteristic 2 (i.e. 2.1 =2 +0). Then a bilinear form on V is 
diagonalisable if and only if it is symmetric. Moreover, if A E Mnxn(F) isa 
symmetric matrix then A is congruent to a diagonal matrix. 


2.6 DIAGONALIZATION OF SYMMETRIC MATRICES 


let A be'a symmetric nxn matrix with entries from a field F, not of 
characteristic 2. Ok, my dear friends, let us come to an agreement, unless 
otherwise stated we take F as R, the field of real numbers.by the last part of 
theorem 2.5.6, we can say that A is congruent to some diagonal n x n matrix, say 
D, that is, there exists an invertible n x n matrix Q, such that QAQ = D. But how 
tofind Qand D? There is a simple method described below. 


Use a sequence of elementary column operations and corresponding row 
“ti to change the n x 2n matrix (A|/)into the form (D|B), where D is a 
al matrix and B = Qt, Then we have, D = Q'AQ. | think an example will 
Clarify it, 


Let 
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Here Aisa 3 x 3 reals 
follows: vmmetric matrix. We start with a 3 x ¢ matri now can we find f? Let's try. 
, l , 
(ln a pge” q(x + y) =fty,xt y) 
1 =i J 
(Al) = (a 2 Ip : s = flnxty) +fOx+Y) 
3 1 110 0 1 = f +E) + £02) FOY) 
z (= 0 311 0 0 = g(x) + 2F ey) + IO) as fy) = fO) 
2 + Cy —1 1 1 0 1 0 1 
3 4 110 0 1 ence, fy) =s[q(x+y) - q(x) - 40)] 
Ro +R; a. a a ples 
2+Rı(0 1 411 21.2 Exam f : 
3 4 110 i r rhe classic example pi a quadratic form is the homogeneous second degree 
1 0 011 0 0 alynorial of several variables. For example, 
a _.._ £ SE P _ avd & hat dope? 
5-H 1 4/1 1 OJR;-3R;/0 1 l 1 0 9 q = q(%,y,2) = 0x + by? + czt + 2hxy + 2fyz + 2g2x 
3 4 -810 0 1 0 4 -8 r : 0 in general, if there are n variables x1,X2)..,)%, then a quadraticq = 
ff @ UT @& tE OTe yo ei xn) is given by 
C =4 t0 T' Oy1 1 o) R3 — 4R, [o i Ole l A | geayxt t apx + + Ann Xn + 2012%1X%2 + 2013%1X%3 + * 24n—1nXn-1%n 
0 4 -24-3 0 1 0.0 ~24l-7 <4, - 
= (D|0*) | i Y 9 yxa 
Where | i=] j=1 
429° 0 } 1 0 0 l idae where Qij = Qj. l 
D=!0 1 O J, Q@'={ 1 1 0Ojandtherefore,Q=|0 1 -4 Then q can be writtenas q =X'AX where 
0 0 -24 -7 —4 1 001 X 
Hence, Q'AQ =D. =|] AE 
Xn 


Please, notice that right part of the 3 x 6 matrix changes only when row 
operations are done. 

QUADRATIC FORMS 
Quadratic forms are homogeneous polynomials of degree 2 in sev 


like 
2x2 + y2 — 3z? + 2xy + yz.They occur in th 


2.7 


in geomet: 


e study of conic : 
ects inclu 


n various subj 


energy in Physics, and have wide applications i a bl | 

Statistics. But here we try to define a quadratic form with the help 0 

form. cal 
initi vector space over R. A function 4 ' y (it 

2.7.1 Definition. Let V bea p metric bilinear form f 


quadratic form if there exists a SY 


f € B (V) ) such that 


q(x) = f (x, x) for allx EV T 


eral variables 


Thus, q = ax? + by? + cz? + 2hxy + 2fyz + 2gzx can be written as 


a h g\ x ax + hy + gz 
a=Q&yz)|h b f (»)=« y 2)| hx+by+ fz 
9 f ep gx+fy+cz 


=ax? + by? + cz? + 2hxy + 2fyz + 2gzx 


R 
€member, here we took, 


4,01) = Qy, = A,X, = X, A722 = b,x, = y, 433 = C, %3 = 


l1 = = 
i 21 h, 023 = 032 = fand i3 = 03, = 9. 
lassificas: 
sification of quadratic forms 
Suppose | 
Look, both he have two quadratic forms. (1) 2x? + 3x3and(2)xf + x} — 2x4X2. 
ave same range set, that is, the set of all non-negative real numbers. 


Bives zero 4 difference, (1) gives the value 0 only when x; = x2 = 0 whereas (2) 
and only if x, = xz, that is, x4, x) may not be 0. Thus, we see that if 
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(1) q= axt 4 3x3 =X*AX where X = 


(x) 4=(@ 9 


then 
X#0,XER 3) 7 0 tor 
Here 0 means th 0 | 
e null vector lok 
(2) g= xf +x} - 2X1X2 = X" AX whereA = ( 1 Fy ih 
A A oh gsi i 
allX € R? and q = 0 for some X +0. For example or 


if we tak 
thenX # 0 but q = 0. $ "E 


1 
(3) q = —2x? — 3x3theng < 0 forall X + 0O XER. 
4 = —x? — x2 2 
(4) q e a and ¢ = 0 for some x 
X= #0, | 
eg. x =(*) 


(5) q = 2x] — 3x} then q > 0 for some X +0, e.g, X= 


F and 
some X + 0, e.g, X = A 0 q <0 fy 


Now, let us classify quadratic forms 


2.7.3 Definition. A real quadratic form q = X'AX where X € R” 
is called 


1 A E Myea(R) | 
(i) 
(ii) 
(ii) 
(iv) 
(v) 


positive definite if q > 0 forall X + 0, 


positive semi definite if q > 0 forall X € R” and q = 0 for some X +0, 
negative definite if q < 0 forallX +0, 


| 


negative semi definite if q < 0 for all X € R” and q = 0 for some X +0, | 
indefiniteif q > 0 for some X + 0 and q < 0 for some X + 0. 
Note that every non-zero quadratic form belongs to exactly one of the 
categories: positive definite, positive semi definite, negative definite, negatie 
semi definite and indefinite.Every quadratic form an R” gives nie toa eg | 
matrix and vice-versa. We say that the real syamnetri matrix A y mens t 
positive semi definite, negative definite etc. if Hip aiec : 
Xt AX is positive definite, positive semi definite, negative definite etc. 


; : 5 
How to find the character of a given quadratic form: 
There are several methods. 


‘ le | 
Method 1. ion together with some simp | 


i i ect 
Sometimes it can be done by insp ony + 29% hen 


TE. 
calculations. For ex. Let q = x2 + 2y* +z" + 
q= (x+y? +0 +2) 
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3, Now, q=0ifxt+y=0,y+z=0 ie. if 
o for all (x, ¥:2) ER 
Z l 


so 4 ; f; A 
are 14) = dand (1-14) + (0,0,0). Hence, q is positive semi 
ms, 17 
fit aay classify all quadratic forms by method 1. So, we need other 
ic not l 
gutitis N 
nethods : t 
yethod 2 hat a given real quadratic form q can be written as q = XtAX 
we know vqymimeti matrix. What happens if we use the transformation 
fe 
here A IS 


y where P isa non-singular matrix? Then we have, 
y= Py W 


took, PAP is also a symmetric matrix as (P'AP)’ = Pt At (Pt)t = PAP as 
OOK, 


4 = Aand (Pt)! = P. 


since PY # 0 iff Y # 0 it follows that X'AX and Y'(P'AP)Y have the same 
definiteness category. Thus a non-singular transformation of the variables 
changes a quadratic forminto another with the same definiteness category. 


Hence, q becomes a quadratic form in Y. Now, we have learnt from 2.6 that 
fora given symmetric matrix A, there always exist a non-singular matrix Q, such 
that Q°AQ is a diagonal matrix. Hence, with the help of a suitable matrix P, we 
can bring the given quadratic form q (x4, x2, «., Xn) to a form given by 


EE) 
+y tetyn Yh- ey, OSmer<n 
which is known as normal formor canonical formof q. 
In normal form or i 


n diagonal form of q if all diagonal elements are positive 
(resp. negative) then 


oai a q is positive (res. negative) definite, if at least one of the 
as te ements is zero and others are positive (resp. negative) then q is 
Estive ij negative) semi definite and if at least one of the diagonal elements 
wi at least one of the same is negative then q is indefinite. 
q XLX}, xX ay) 2 5 

3) XI + 2x5 + x2 = 2X1X2 — 6x4xX3 + 2X2X3. Thus, 


_ Xi 1 -1 3 
1=X'AX where x = (2), A=(|-1 2 1 
Here 4 is *3 > k d 
a 3x ‘ 
follows: 3 real symmetric matrix. We start with a 3 x 6 matrix (A|I) as 


1 
(Al) = K 


=] 
2 
3 1 


3⁄1 0 0 
10 1 o) 
110.0 1 
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1 0 381 0 
are (—1 1 10 1 
3 4 10 0 
1 0 3j 0 
mF Ri(0 1 441 1 
3 4 110 0 
1 0 Of1 0 0 1 
a= (0 1 4]1 1 0 R= aR; (0 
3 4 -810 0 1 0 
1 0 O41 00 1 
a=F(0 1 0 |1 1 O|]R3—4R210 
0 4 —24I-3 0 1 0 
7 1 0 O |1 0 O\F 1 0 
e(o 1 0 11 1 0) aa O T 
V24 ° \o o —v2al-7 -4 1/V¥24 \o 0 
= (N|P‘) 
Where 
1 0 0 7 
w=(0 1 o); Pt = 7 
0 0 -1 -— 
v24 
7 
te ch es 
and therefore, P=|0O 1 -= 
1 
0 0 Ta 


Hence, 
isy? + y2 — y? and therefore the form is indefinite. 


PtAP =N and the normal form of 


0 
o) 
1 
0 0 1 0 
1 4ļ|1 P 
4 —8|-3 0 1 
0 
0 ~—24|~7 Zm 
oli iA 
(0) 1 
1 : 4 i 
7 -S= m 1 
Vea a 
0 0 
1 0 
4 1 
24 V24 


the given quadratic form 


We obtained the normal form by the substitution X = PY i.e. 


oe oe 

x4 4 

2) = 0 1 -— 
X3 24 
1 

v24 


That is, the required substitution is 
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x3 = Ta” 

iteness Of the symmetric matrix A or the quadratic formq = 
mar :For defin! ssary to bring A into normal form, it is enough to bring it into 
rial, it is not jar d one can determine the definiteness of q by watching the 
* ago"?! pe 7 ly. If you are asked to find normal form then you have to 
: a tement ail that is, to a diagonal form containing 1, —1 and 0 only 
ail ies gë normal form of q, negative signs come after all positive 

onal a 


, 


ing: FOr €% 


SIE 
normal form. 


method 3 


know, that eigen values (if you forget, please consult my book Ring Theory 
We now, 


-ogr Algebrajof a symmetric matrix are all real. Thus, if q = X'AX where A 
ani ic matrix, we can find the eigenvalues 4,2, An. Then q = XtAX 
a ene negative) definite if A; > 0 (resp. < 0) for all i = LZ, sty Is 
; ja PAA negative) semi definite if A; = 0 (resp. < 0) for alli and A, = 0 for 


je k € (1,2, n}. Now, q is indefinite if there exists some A; > 0 and some 
some br a 

2. < 0. 

i i = x? + 5y? + 2z? — 4xy — 
Example. Let us consider the quadratic form q =x" toy z y 
6yz + 22x 


1 -2 1 
(- 5 3 
1 -3 2 


The characteristic equation of Ais |A — AI | = 0, i.e. 
1-A -2 1 
| z 


x 
Here, q = X‘AXwhere X = o) A 
Z 


5-4 -3 |=0=> A4=0414V19 

1 —3 2-A 

Since, at least one eigen value is 0 and others are positive, the given quadratic 
form is positive semi definite. 


2.7.4 Theorem : A real symmetric matrix is positive definite if and only if all its 

eigenvalues are positive. 
Proof. Let A be a real symmetric matrix of order n. Then all eigenvalues of A are 
real, say, Ay,Az,..,2 


ne 
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S 


that P7ŻAP, equivalently, Pt ts a 


. P no 
AP, ISa diagonal matrix Tthogonay 


Let PAP = di 7 
cand diag (Ai, Àz; ..., An) where AA ii Sy 
= ] anddetP™!detP =1,wehave, _ 2 sAn are eigenvaj i 
, a Ues 

= i 
det(P~*AP — Al} = mia ae — P-1(AI)P) = det "Sh 
= = Phin m i 

det P~! det(A — A/)detP = w k ~Al)py 
~ Al) 


Hence, the matrices A and P7 


1AP h 
5 ave sa ; 
A4,A2,...,A_ are eigenvalues of A. ine El3envalues in 
IN othe 


Since, P i sët = : r 
 P is non-singular, P™ŽAP is congruent to A If Aj Mord 
-IFA is positiy 


A is congruent to /,,. Therefore, P~1AP is congruent tc = def 
Hence, all A; > Ofor i = 1,2,..,n. - * 
Thus, if A is positive definite then all eigenvalues of 4 
are positiy 
e. 


Conversely let all ei f if 
f 7 positive, i e 
Then diag (Ay, 22, ied IS positive definite. i ' 


k >0 for į =] 
But A is congruent toP~AP = diag (A,,A So 
1/2; 


: | b An). 
ence, A is positive definite m 


Note. Simi i 
ote. Similarly, it can be proved that a real symmetric m 
a 


if an if all its ei ix j 
d only if all its eigenvalues are negative. trix is Negative definite 
l 


Method 4 
a h 
A real symmetric matrix A={h b 
is positive definite if and only if ars 
h 
a>0 ü i h i 
i is p| >0and |h b fl>o 
g fc 
and ís negative definite if and only if 
a<0, ah sE 
k p|>0 and |a b f]<o. 
g9 fe 


Example. For the matrix a=- Fi 3) 
l : 0 -3 14 
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2 -1 O 
Z ‘eases and|-1 2 -3|=24>0 
270 a 2 0 -3 14 
e 
eX 5 
| jis positive definite. 
pence Aben real symmetric matrix, and let D be a diagonal matrix 
5 finition A. Let P denote the number of positive diagonal entries of 
i ngruen one of negative diagonal entries of D The numberP is called 
À be a A uadratic formXtAX and the number P — N is called the 
ie) , 
inde a ch of the quadratic form X‘AX. 
sgt? ank of the matrixA, then we have P + N = R and hence signature 
if R be the i _ p) =2P - R. Some authors prefer to define signature as 
ain x — Rank. Thus, if we denote signature of Xt AX, i.e. of 


meN” 
e” that i5,2 X Inde 


awe te 
s=P—-N=2P- R 
—ary quadratic form X‘AX, that is/A isann xn 


say that, an n 
P and y aé defined above is 


e, we can 
with rank R and signature S having 


Henc 
symmetric matrix 
definiteif Pan (equivalently, S=n) 
emi definiteif N = 0, P = R < n ( equivalently, S = R < n) 
=0,N=R=n (equivalently, $ = —n) 
= 0,N = R < n (equivalently S = —R < n) 


positive 

) positive $ 
(ii) Negative definiteif P 
(iv) Negative semi definite if P 
(v) indefiniteif P 2 JandN 21 


2.8 SECOND DERIVATIVE TEST 
it is interesting to show how the theory of quadratic forms be applied to 


multivariable calculus. But before that we need to understand the followings. 


Let f : R” > R be areal valued function and we can express as 
z= f (t)where t = (ty, Ëa stg) ER, le, 2= FE Chis Soyer tn): 

Let all third-order partial derivatives of f exist and are continuous. 

The function f is said to have a local maximum at a point p € R” if there 
exists a ô > 0 such that f (p) 2 f(*) whenever||x — pll < 6. Similarly, f is said to 
have a local minimum at a point p E R” if there exists 6 > 0 such that 
f(p) < f (x)whenever ||x — pll < ô- if f has either local minimum or a local 
maximum at p then we say that f has a local extremumatp. 


A point p € R” is said to be a critical point of f if ae = 0 fori = 1,2,...,7. 
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We know from calculus that if f has a lo 


cal extremy 
cntical point of f. For, if f has a local extre yi 


mum at 


i nii P 
any t= 1,2, vey n the function ip, sii ‘ee 
i | ky, 
9; (9 cr FO. Dz, Pil t, Piss s1 Pn) has a local extremy definey the, h 
have, fii x : 
Pi. Thug ` 
IFP) _ dop) X 
dt, dt ` 
Therefore, p is a critical point of f. But critical points are 
extrema. notn 


“Ce Ssari lo 
The second order partial derivatives of k 


to test for a local extremum at p. The 
(ai = where 


f ata critical point 


: P Can 
se partials determi Often 


n Ey 
É matri 


BON 
” (atah) 


This matrix is called the Hessian matrix of fatp. 


Since the third order partial derivatives of f are continuous, then 
af) _ ofp) 
(9t;)(05) (04) (@t;) ’ 
Hence, the Hessian matrix A(p) of f at pisas 
values of A(p) are real. 
Example. Let us consider a function f:R*OR given by f(x,y) 
y*and p = (1,2). We wish to have Hessian matrix A(p) of fat p. 
Here, f,(x,y) = 2x + 3y, hy) = 3x + 2y, fo x,y) =3 = fry 
So, £.(1,2) = 9, §(1.2)=7, fy@y) =3= Flt, ¥). 


meso G 3) 


2.8.1 Theorem (The Second Derivative Test) Let f (t1, t2, ...,t,,) be a real valued 
function in n real variables for which all third order partial derivatives 
exists and are continuous. Let p = (Pi P2: --,Pn)be a critical point of f, 
and let A(p) be the Hessian of f at p. 


(a) If all eigenvalues of A(p) are positive (i.e. A(p) is positive definite) 
thenf has a local minimum at p. 


i.e. aj = Fi 

ymmetric matrix. Thus all eige 
, n 

Sy? 

=X Tey 


(x,y). 


(b) If all eigenvalues of A(p) are negative (i.e. A(p) is negative definite) 
thenf has a local maximum at p. 
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nd at least one negative eigenvalue 


itive a ne 
has at a par eer f has no local extremum at p- (In 
API. indefinite) HE” i 
A Tie. AP) Ë iy a saddle point of } B ive 
a ú gar ve both positive or neg 


ha 
< nand ACP) pasa not 
nk(AP?) if A(p) iS positive sem i 
j vative test is inconclusive. 


e 7 
a i definite or negative sem 


sep Pn 


E sp peeled 
y= flat py te + Parr En + pn) — f PL P2 
yt = 
i gliv t2 | 


(maximum) 


0). . . 
a to the corresponding partial 


| minimum at p if and only if g has a 
as a local m 
oth (maximum) at 0 = (0,9, --- 


are e 
rtial derivatives of g at 0 
pa 


a. The ves of f at P- 


`- gerivati 
3. g 0) = ° ., 99) — o foralli = 1,2, -on 

0i a critical point of gle “ae; 
4. IS 


= (aj where 
essian matrix A(p) = (aj )axn 


af _ 3 
ay =a) Ott) 


ound 0 and we get 


aag, ix: 7a 
D EACS 
g(ti tz P = g(0) Ds at; L ati (at) j) 


+ S(ty, tze En) oo (1) 
ie. S : R” > R) such that 


s, The H 


Let us apply Taylor’s theorem to gar 


tit; 


1 n 
wheres is a real valued function on R” ( 


S(x) — S(tutarwit) 2 9 .....(2) 


im roiz T im 2.. t tÊ 
lim alte (tytzrntn) 70 tf + t3 + + n 


i mes 
299) = 9 forall i= 12y T, equation (1) beco 


Since, g(0) = 0 and a 


14 g0) 
it) = 2, Otay) 
ij=1 


Ben 5 err 
g(t, ta, , 
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let K: Ra 
= R be the Quadratic form defined h 
Y 


i ý 
KiS ja- Y To 
E, 2m (tət) t =se (4) 
let H be the sym 


metric bilinear form 


Standard ord i ie i 
ered basis for R". Then H has Ponti 


: bee, the Matrix represent ang B bs 
atio ~ 
1 a? l i 
Boat 90) 3 
ij Sre r Ta 
e Otat) 2w 
Hence, We (H) => A(p). 
Since i i 
, A(p) is symmetric there exists an Orthogonal mat 
atrix Q such 
that 
4,00 
QA@)Q = | F420 
00-2 


is a diagonal matrix whose diagonal entr 
p= {v1,2,...,0,} be the orthogonal b 
ith column of Q. Then Q 


¥ —coordinates into £ 


ies i 

7 = the elgenvalues of A 

si n 

i fe i S tOr R whose ith a i let 
i change of coordinate a OF is th 
— Coordinates and hence, "x changi 


Ng 


419 0 
WE = Op (ING = Ega =| G2~° 
Son 


Suppose that A(p) is not the zero matrix. Then A(p) has non-z 
Let us choose € > 0 such that e < ! 


— 


a ero eigenvalues 
: for all A; + 0. Now, by (2), 


So, porte exists 6 > 0 such that for any x € R" satisfying 0 < ||x|| <6, we 

x Š i 
have, Tepe SE that is, |S(x)| < e. llxl||?. Consider any x € R” such that 
0 < |Ix|l < 6. Then by (3) and (4) 


lg(x) — K(x) = |S(x)| < ell, 
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(x) < elixll? 


12eg) K 
ee y K(x) + ellxil? = (5) 
(x) elx? < 9) <$ 
g K 3 
e Sy, 520071 Sn are scalars. Now, - 
' i M eee S 
ser „wh a — 
a | ean” nUn! AAs 3 
n Tia EIT typ = 
oe : 2H Se I EJ i 
[xt s? goo st | as uV} 
2485 
= Si 
n 
= Si 
izl 
lon 
yx) 25 )icl iSi 


1 i b 
i eigenvalues of A(p) are positive then 54; —€ > 0 E ee 
fall el 


iet inequality in (6) 
n 
1 
g(0) =0< Ae - e) s? < g(x). 
i=l 

Thus, g(0) < g(x)for lixl| < 6, and so g has a local minimum at 0 and hence 
f has a local minimum at p. by a similar argument using the right inequality in (6), 
we have that if all of the eigenvalues of A(p) are negative, then g has a local 
maximum at 0, that is, f has a local maximum at p. hence(a) and (b) of the 
theorem are proved. 

Now, let A(p) has both a positive and a negative eigenvalue, say, A; > 0 and 
4, <0 for some iand j. Then sai -E> Oand- A; +eée<0. Let s be any real 
number satisfying 0 < |s| <6. Substituting x = sv; and x = sv; into the left 
inequality and the right inequality of (6), respectively, we get 

1 
g(0)=0< (54 os e) s? < g(sv;) 
1 
and g(sv;) < (Fa, + €) s? <Q= g(0). 
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Thus 3 j 
7 g attains both positi 
nei ve Positive ; 
$ thera local maximum sehr and negative Values arn. ` ; 3| matrix 
_ a local maximum nora local mj ocal minimum at g arbitrari ation on A(p) to get? Ginga 
For'the last minimum at p, Hence pie show close ongruene a 2 0 9 
i £ F(t, t2) = t2 _ H us Consider the f ed, Nas Ih, et" i 3 2% C2 + 2 Cy 0 7 —3 
atp = 0. In both cases, the : l 2 G(t,, bje 2 UNCtion. “th, Ry pg“ 0 2 4 —3 14 
; unction has a critical poj itta 0 -3 1 » i 0 
inta 
O 0 tP, ang 77° P 
However, F doe 0 ) se 10 = 3 Cz + 2C2 0 7 
minim S not have a lo R + 2R2 2 
umat0 m cal extremum " 3 a8 00 8 
. Ex Ow — i d 
aia Let f : R? s Rb l hereas ¢ ; tive, the matrix A(p) is positive definite an 
e a function giv has i al entries are pos! $ local minimum at 
ony + all diag" < siye test we can say that f has a 
fay, z) = +2 2 Oey since ond derivative 
First x + y* + 722 py the sec 
» We set the Partial derivatiy i =xy = 3yz te 
es of first o 0,0): 
Ee, y, z) = 2x sjed ; ' rder equal to 0 (0 ajternatively =] 0 
j x, = | = — —3 
i Ee = ad y,z)=2 is | 10 =( 1 2 
2 if m zC Y.Z) = 14z -3y = 0 xX A Be 5 0 = 14 
Since k ' — 0 
s 2 oa 1 
0 -3 a * 0, we see that (0,0,0) is th es É “ll =3> 0 and|-1 DR) = 24 >0 
© ONY solution, f | wesee that a a ġo -3 14 
| the matrix A(p) is positive definite and therefore, by the second 
and henc t we can say that f has a local minimum at (0,0,0). 


f(x, = 
zyz) = f(x,y,z) = (x,y,z) 
NZ) =0 | 
| derivative tes 
| 


Ria (0,0,0) is the only critical point of f 
| YLVESTER 

29 5 
e know that, by a suitable tr 


Pisa non-singular 


's LAW OF INERTIA 
diagonal form like 


ansformation X = PY, where 


| 
wW - 
Xt AX can be brought into a 


fx%¥2)=2, f (0,0,0) 
ay = 2 
hy (x,y,z) = 2, fyy (0,0 0) matrix, the real quadratic form q = 
VAM = 
faz (x,y,z) = 14 ° | DHA toot Ard = ee ee tt 0. Yn 
‘Sez (0,0,0) = 14 | form lik 
| grin normal form ike 
l 
= yh + Oyie to + OYA 


fy (x,y,z = 
j=- üis hee e 
f fely, z) =-3, f (00 | yi +y? Yn Ym 
a es 3 | Remember, normal form is also a diagonal form whose diagonal entries can 
take value only 1. —1and 0, nothing else. Now, the number r, the number of non- 
ro entries in the diagonal matrix congruent to A is called the rank and m, the 
trix congruent to A is called the 


hex (x, 2) = 
Writing p = 4 ay ie is y=, fzx (0,0,0) = ~3 | 
aad ave, : i ze 
‘ the Hessian matrix A(p) of f at pas | number of positive entries in the diagonal ma 
apa ies fry (p) fz) | index of the real quadratic form and we also know that s=2m—r is the 
A yx) fry (p) fe(p) ) = 2 -1 0 | signature of q. Now, the question is whether these numbers m, r,s are uniquely 
fzx P) hy (p) fp) T 2 = ) determined for a given quadratic form q. In other words, if we apply another 
—3 14 | transformation X = UZ, where U is a non-singular matrix, and we get a diagonal 


l form like 
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2 2 
HIZI + Uaz + 4 Hkzę — Mry2z 
PI Ges 
then can we Say that m = 


My,.22 
k? The answer lies in the im 


22 | 
follon.. r4 | 
2.9.1 Theorem. The number of positi owing t a“ | 
; POsitive elements i Or D.a 
of a real quadratic form is invariant mine m N 
Proof, Without an l i " (a | 
y loss of 8enerality, we consid “Re 
T Only no "ay 
— P x ., 
Let q= ¥ tAXbea real quadratic form where y M | 
=|% 
Let X=BY B bei i h 
7 ‘ eing a non-singular Matrix, 5 | 
transforms q to the normal form eee g Ubst; | 
tut 
2 ae 2 | 
yi +y; T E Ym m Tr ASS y + 0. y2 4 E 
i ; PET SP sig 
let x = CZ. C being a non-singular Matrix, be anot Foye 
transforms q to the normal form ner bstity, | 
2 oe 2 2 Whi 
a tzt a a "y 
We claim that m = k. If not, letm < k. sr | 
Now, Y=B-1xX and Z= CX. let grin (dy) 
Thus we have, n ea (e) 
t 
— “ 
Y = Bray + jax, + + bin xp, fa i 
and 
Zj = GjiXy + G2%X2 +-+ Cin Xn for J = IPA oy N, 7 (1) 
Let us consider m +n — 


k equations in n unknowns 


D + Dat fo + Dinn = Ù 


bmixXı de Din2X2 yo Diin xX, = 0 


Ck+11X1 E Cee41)2%2 Fe + Chaa nX, = 0 


CniXy + Cn2X2 Fee + CunX, = 0 


Since, m <k => m-— k<0=>m+n-k< n, 


equations has non-zero solutions. Let X 


the above System of 
solution. 


= ETAN ME be such a non-zero 
wnend =X Ay =Y ay asa d or’ = (24,250 0012), 


1 
Linear Algebra Ve 
t 
; P as 0 and las 
= Ym 
n (1) show that y1 P20 z, = 0. 
it ak eRe 
ns toB ay show that Zeat = t 
ym 10Be LTT +e, Or 
fi? jat" k 2 — yr 1 is 
NA ea e ' Ym+2 1 a =° = Lk 7 
tk we heer = —ymt * = 0 andzı = 72 
r pw’ ' Xn) ' = yr 0) 
T 1 , $ = Ym+t 0) z' = 0 = (0,0, , hich 
(xr ff ymt pe ds w 
; pP i 207 (0.0 — BY = 0 = (0,0, 0) 
rh? P e get lar, we have, 
fo ngula" 
re sing ktm. 
Li i zer hown that k 
p > es 
a” pean k. Similarly, it can i 
i dict’ p hows that M ER 
1 tion N° 
co" d 
; ic form q@ re 
this” ok t for a given quadratic the signatu 
ences is invarian 
n 


ruence, 
is invariant under cong 
kris 


a the TOP 


i on the 
functions 
f continuous real valued 
ace O 
be the SP 


1 y, define 
for fig e's 
interval [0,1]. Fo jia | rosod 
H(f,9 0 


N 
tf EV. Now, 
\ Ha bill npe Vand c €E F. Clearly, efit 
n. Let fir Pa» 1 t 
= =| (cit MOsO 4 
Heh +f ~ Jo 


\\ 


[ (cht) + AOLO dt 


J0 


=p 


1 : 
` ; (DAE) dt 
ADIO dt + | fr (t)( 


“0 


= ctf; g) * 4 (fo) 


g , € ' ve ave, 
y i g2 
Sit , 


i 


} dg +d p | t d + t dt 
2) | fe ah gy - go) Jí 
IQ. AS 92 Is 


i 


d 
[ roaa + g(t)) at 
0 


“0 
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1 ‘ 
=a | Fe goca Tapita ° 
0 I(t) dt ef F(t) (rod TOP) t p 
= 92 (t) = a y) 
Hence, : ms a HC, g) + 9 dt J 4 T(H) 2Y 
; H isa bilinear form mn 1) + HCF, g3) os TH) Gay) g 
- Define H: j gdeF we , 
Rb yar Y2 
PP R? yY H(t, t) = T go” yı T(H) (x, d¥1 + y2) 
oluti 2-1 4 
ton. We take (1,1) E R x ee SHa bilinear, — H(T(x), TaN + y2) 
but2H(1,1) = L1)=H(21) => = 
"i n A) = 2(1 + 2.1) = 6. T2 īa 4 ii H(T(x), TOW) + H(T(x),TO2)) 
, 1,1) + 2H T 
3. P (1,1). Hence. His not a bilin = d?(H) (Y1) t TŒ) y2) 
rove that the sum of two b ear form on R . h words TCH) E B(V). 
Solutio o bilinear for ak te pilinear on¥, in other i 
as n. Let Hy and H> be tw ms is a bilinear for Hence: F(H) is Bl over a field F and B(V) be the 
ine field F. Let us define H ieee forms defined on m tV be an n—dimensional vector ee et Ai be the matrix 
Shall show that H is bili äi x V => Fby H(x _ a vector Spa 5. Le i bilinear forms on vV. For , 7 f V. Then prove 
Hia ilinear on V. Y) =H 4) 4. CE V oyy set of al f H with respect to the ordered basis B for 
e , È ti no ` 
Xi X2, yY E V andc EF. Then 2, y), W ye linear for any ordered basis B. 
H(cxy T X2, y) = Hı (cx of ne _ v v y be an ordered basis for V. 
LT 2. ¥) + Hp (cx, + x5 y) solution. Let B = {V4 Vz Mn 
= cH (x g es = 
eae ty Gory) CH2 (x1, y) +H ( let Wet) = M = (my Jaren 
, 2 X2, y) = = : M Ve 
Then we have, (YED); Sn = H(i) 


[as H, H are bilinear] 
= c[H, (x 
1,9) + Ho (x1, y)] + Hı (2, y) + Hp ( 
sey c H(%1,y) + H(x2,y) ee 
y, Tor x, Y1, y2 E Vand d E F, it canbe shown th 

; n that 

PNO ee + ¥2) = dH(x,y1) + H(x, y2) 
7 = A, + Hz is a bilinear form on V. 


orc EF, we have, 
+ H2)); = (cla + Hz) (vi Yj ) 


= cH, (vi, vj) + Hp (vi. w) 
=c (Ws (H:)); T (Ys H2));; 


for Hy, H2 € BV) and f 
(app (cM 


4. Let V and WwW b 
e vector spaces ; 
over the same field F and let T : V > Whe Hence, Wp (H) is linear. 
hat (i) any square diagonal matrix is symmetric and (ii) any matri» 


a linear transfo ; 
rmation. For an 
yY H E B(W)[ (W) bei 
eing the set of all 
6. Provet 
congruent to a diagonal matrix is symmetric. 


bilinear forms on W 
n W], define T(H) : 
, :V x Vo F b om 
y TH)%y)= 
be a diagonal matrix. Then 


H(T(x) T(y)) fo 
; ral xyev. i î 
a a y Prove that if H € B(W) then T(H) | Solution. Üe A = (ay) 
| olution. (i)Le = (Gi 2 
olution. Let x1, x2, y E Vand c E F. Then 7 
" ay =a =0 fori +j. 
TCH) (cx, + x2, y) 
= A(T (ex + x2), T 
=H ( cT (xy) +T(x2),T 2), oa) , i (ii) Let A be a matrix congruent to a diagonal matrix 
2), T(y))[ by linearity of T] í invertible matrix Q such that B = QAQ, thatis (Q*) 


Hence, Ais a symmetric matrix. 
B. Then there exists < 


-1 BQT} = A. Now, 
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A = ROBEN (Q7 ye pe second derivative test for 
= Uig P Koi variation of the 
Hence, A i i Q [as Be z B byti | sollowin’ 2 
+ AIS Symmetric, My (i) a he 1 a*f(p) 
=. ates gy 0] EE 
7. Let V be a vector space 4 gh _ || a2 Oty 02 
be a symmetri b eee Not of ch | i a ati : 
aeia ric bilinear form on V. Prove t racteristi | a local minimum at p 
atic torm associated with |: hat if Ki Wo af) ~ 0, then f has 
" then show that f Ys ng gand g = 
1 Or Xy t ane ati imani at p 
H(x,y) == Ally y et) A D7 al maximum 
Sol | BEAN RD pe oye gfo) < 0, then f hasa loc 
olution. Using bili i nd ae 
on. Using bilinear Property of H, we have p ip? oant ~ ati » peal extremum at P 
’ has n 
K(x +y)=} „then f 
(x +y) A(x + y, x 4 y) ©) fD < 0 the test is inconclusive 
= H(x, x) 4 7 _ 0, then 
f x) + Hy, x) +H TT (d) \f D i 
| ~ A EEE ty ix A(p)of f at p '58 
| as H(x, y) = H(y, ð, y) + H(y, y) 1J) matrix A(p 


jon: ian 
sou, the Hess? 2 
a fore afl) re 
ate Oty 2 
= 2F(p) 
A@)=| aero) CTR 

dt, 0t2 dtp 


H bein 

| g Symmetry; 
E ic 
Since F js not of characteristic tw : 


. 0, 
arbitrary(x,y) EV x V. Hence, ne TENS 2H(x, y) T 
fo 


1 
H(x,y) = 51K +y) ~ K(x) - 


2 
KO). af df) _ pel i 
8. Let K: R2 ; p= det A(p) =- ati Seea 
: -> R defined by K (3) = 9 2 oblem, we have, 
quadratic form. Fi b) AG" + dab + p oo dA 
rm. Find a symmetric bilinear “Tik fA(p) be A anaa 
H (x, x) for allx = ( 3) E R2. that Ko), Let elg 


as) 5 9, 

a p = det A(p) 7 dander 7 
£ c 

Solution. Let x = ee y= ( 


Since, : 
€ R2, T j Hence, 
i hen using the formula 32/0) ~ 9, otherwise, D could be < 0. 
1 EE a 2f) f) 
HY) =U K( + y) ~ Ke) ~KQ)] A(p) = PHO) , FFP) >0 
ata = trace A\P at; 2 
We have,H(x,y) =2[K(2T°¢ a c 
: , —K = = 
al f + a) (3) K (a) Again uh = det A(p) = D>0 ene aiii Hence, by the second 
1 i ' both A, and 42 4 à 
af 2 .< ig possible, only when inimum at p. 
zla +c)? + 4a + c)(b +d) + (b + d)? — (—2a? + dab + b?) pra ve can say that f has a local minimu ; 
eri 
— (—2c? + 4cd + d?)] a on ait af) must be less than zero, otherwise, 
d—7 < dt? 
= —2ac + 2ad + 2bc + bd. (b) If D > 0 ane ge $ 
H ; would be negative. Hence, 0 
ence, the required symmetric bilinear form H is given by | ay t Ag = trace A(p) < 


a C 
H (ia = —2ac + 2ad + 2bc + bd. snddydp = det A(p) =D > 


UP THE 
ORY & 
Y& LINEAR AL 
This is pos $ GEBRA 
derivati sible, only wh 
ve test en bot 
(c) IfD<Oth ey nabs. and A, a Linear Alge 
en we h as 
In this ave, A,A a locaj n eti 
case, o 142 = det Ve, 
n ’ i N 
Hence, by the s eof dis,i= 2 A(p) = Mum ‘i Ence , 
ec , 5 š 
p. ond derivat must be 0, b Vth F linear ing from f : V 2 FIs 
IfD = 0, the » WE See th fa aT aj gue” yecto" 5 Thus he following definition 
ier n by the relati t, f h Othe, yp pe a patton A pa 
; ank A(p) < ion, Ady = Sno | Ne heat AA a r a field r. a mapping f fro™ 
inconclusi 2. He 2= D= fe] a Is [irr A c i . rt 
clusive nce, b 0 ley, Se yeti y if atisfies following prope y 
: à y the see Xtrem, tj, 3 jos fine p function? 
xerci n ę, i a Pi = 
= d derivatiy Ma PHa (cv tY cf (vi) * f (v2) 
S tes v2! y g alt scalars € Ù F. 
ý the v an 
rors 1 
ive’ 
of? les 
amp” Define 4 functions * 
yo 7 oh i id and jet ay, 42 an PE scalars IN F f 
yet 
inite di is i functional on V 
on imensi a > check whether f 1'53 linear func ional o 
V. Show that the ensional vector n equivalence ieh pere 2” CH „j. letus f 
j equation Space and zZ, h e relation w i = (vy YE n) nd w = (Wi W2! Wa) be two elements of F 
defi uv) = LL, i e 
es a skew sym v) = Li (u) w) ~ L. 2 linear 5 and E ae 
A nly if Lı, EA _ a bilinear fo = Liv), G Ctionay HG + w) = f(c”: + w4, CY2 + W2: ,CVn + Wn) 
: ar rm 
ra T bè ahy skew ly dependent. on V. Show m a (cY: +w) + az(cv2 +w) + + An(CUn + Wn) 
In S 5 
ear functionals L ymmetric bilinea at fzo; | selat t an + apnYn) t (w t W2 e+ Wy) 
fo fav) nie n RŽ. Prove th = cf(v) + fw) 
r , = 
all u, v € R. Liu)L w) -L w) at there i so, f is linear and hence is a linear functional on F” as co-domain set off 
5. Let 1W)L e ; i 
K : R? 2 (u) the scalar field F 
> R n 
quadratic f defined by pri if {er 22" en } bE the standard basis of F”, that is, ei is a vector in F” 
orm. Find to) = 7 = hose i th co-ordinate is 1 and all other coordinates are 0, then we have 
H (x, x) f a symmetric bili 1— 8titz + 22 i : 
orallx = (1 bilinear 5, be METE ) 
rs z= R2. form H Stich a real 1,2 ı “n 
6. Let K: R3 that K(x) = = vı (1,0, 0) + V2 (0,1, +e + Up (0,0, eh 
>R defined by K (i | = vêl + V2€2 a + Un en 
real qu ; a = 372 n 
quadratic form. fi t> ti + 3t 4322 — 7 
ind a s 3 — 2tyt = ) Ye 
K(x) = H(x x) f ti ymmetric bilinea 1°3 be a | jal 
(«:) E R3. 1 such that Now, f(@) = f (0,0,1, = 0) = dy 0+ a2.0+ papt tet ta” 
š Therefore, f y= qj for j= Tet 
Thus, we can write, 
fw) = j=l fe )v 
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2 fetFb 
@ a fi 
teld and n be a positive in 
teger 
- Co 


Marxen (EF 
n (F) consistin 
€ of alln 
xX n matri nsi 
tet A = (a;;) EM atrices who Ger; 
age: bt «| nxn CF). Define se ENtrie Vector 
S $ 
trA=a ii 
b M i eoa 
“a 
nn 


Then tr 
ace function i 
ction is a linear functi 
tonal o 
n M. 


A,BEM 
nxn (F) and fo 
re 5 
E F, vwe have, nxn (F) as for 


n 


n 
) d ‘(cay + bi) = n 
ma ; aai LESA. 


Let V* de l : 

> enote i=1 7 u = 

a field F, that ic the set of la Ctr 4 b 
Fy rp 

7h 


V* = {f : 
I f:V > Fis tj 3 t 
near}, % 


ala ipli 
r multiplication ony" 
as fol 
(f + g9)(v) = S) + ge ) k 
v 


(af = 
for all vy € V and for alla e F JE) = alf wy) 


We sh 
all shov 
v that V* is a vector spac 
s e over F 


(1) Let f, g E V° then f 
A oe z is linear as for v V; 
1 + v2 i= f (cv Fi i ái na 
= efn) forte D 
Th eh i 
(2) esi EV" => ftg on ie ; 
en forany v E V, we “ 


GF + g) 
So, f+ C) = fv) + ¢ 
(3) 47h Ioa 
Clearly, addition is ae i 
Ive. 


(4) Defi 
ine 0p: V > 
i F by 0 
v 


V >F b 
y 0p (v)= 
yvw E€ =0,VvEV ; 
Oy (cv + V and for . We first 
w) = = anyc EF 
) 0=64.0+0=cOy(v)+0 , we have, 
v (w) 


Therefore, Oy E V* 


Now Ga + Oy )( v) = ) r) = + = ( v Vv E V 
, ) 


(5) yE 
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that is, Ov is the identity element in y= 


i áa 
ai* Oy 7 vi = 
tre ition- 
gait! . 
ra ev" (1 ev’ and 


und? 
gora KORAS 
tis, inverse of 


forany v EV, 
DV) f@) —f@~= 


f under addition exi 


(wv) is 0 = 0y Y) 
m _f, tha sts in V” for 


n abelian grou 
ae - and fora 
=nll + pw) F alf Œ 
= (af + ag)() 

= af +49- 
re y~, we have, foranyv €E V, 
b) fv) = of (v) + bf 
bf, Vf = y* and for al 
y*, we have, foranyv EV, 


fv) = albf (v= a(bf)@) 
dforalla,b € F. 


ey 
p under addition. 
for any Y € V, 


e F, we have, . 
j + gv) = of 0) + ag(v) 


af +9) 


c F and 
(v) = (a+ 


ES a 


= (af + bN) 
| a,b EF. 


therefore, 
e F and forf © 


CO ab 
(ab)f = a(bf) for alf E V* an 
e F, we have, foranyv EV, 


anw) =1/0)= fo) 


1f = f forall f © v“. 
tor space ove 


(8) For a, b 


therefore, 


(9) for f E V“ and 1 


r the field F. 


eofV. 
ting of all line 
defined above. Now, 


Thus, 
Hence, 
This vector space 
Hence dual space 


y with the operation 
duce a new concept. 
dimensiona 


Vv‘ isavec 
V* is known as dual spac 
or space consis 


of V is the vect 
ions as 


s of addition and multiplicat 


d let B= {x1; Xz: zè 


| vector space an 
A2, ---: An such that 


e V. Then there exist scalars a1, 
x = aX + A2%2 ++ AnXn 
„n define fi V > F by fi) = ai 
coordinate function with respect to 


intro 
Let V be a finite 


ordered basis for V. letx 


For each i = 1,2,-- 
Then fj is called the ithc 


that 


fig) = Ofte J and fi In brief, we can say fi) 


j= 1ifi=j. 
5 aay 
ij oifi#j 


ij is known as Kronecker delta. 


ar functionals on 


.,Xn} be an 


the basis B. Note 


= Oy where 
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Since, fi fav... fe z y* 


ESAT E 4 ' WE see that 


njn E V“ as Q 
D’ ia) Qn are SCalars. 


Qs; 5. 


Therefore, for n 


E Siven scal 
taj + --- 


ant oe avs C3, C, 
© Caja ÎS a linear fun 


soy, the line 
> ar 
ction an c 


. om 
d its value at any basis y > 
OENAR Wk 
i 1A) 4 fa) + 04 cfi 
tJi 
= clas fi(x;) = Oifi 
Now, we wish to show 


* J and f(x) z 1] 
vy". 


that the v 
ectors f, f, -fn are linearly indepeng 
dent jy 
= — t : 
wd Safi Pa nee Saf Codey = 0p where 0 
0, Yx EV, then f&)= Oy G@) = 0 for atti 
Thus, f@) = “= Ulori= 17 2 


Therefore, the set Winkie ak, 


h th 
= Lah. at 


Oy(x) N 


yis linearly independent in an 
Let us define a map T:V > y* by 


n 


2 aifi 


i=1 


T) = äfi + ah t+ anf 


whence x= a1X1 F 2X7 + +--+ a,x,. 


It is easy to verify that T is an isomor 


phism and hence, V is isomorphic to v’, 
the isomorphism, however, depends upo 


n the choice of the basis in V. 
Therefore, dim V* = dim V if V is finite dimensional. 
Thus, if dim V* = dim V = n then the linearly-independent set {fis fareof) | 
of vectors in V* is a basis of V* as any linearly independent set in V* containing n | 
elements is a basis of V*. 


This basis {fi, f2, ---, fa} is called the basisof V‘dual to the given bass 
{x1, X2, ee | of V. 


i ; y 
2.10.3 Definition : If B = {x1,X2,...,X,} is an ordered basis of a vector on 
and V* be the dual space of V, then the ordered basis B an n 
that satisfies fi(4y) = ôy (1 < i,j < n) ìs called the dual basis o! 8- 


iof 
be a basis 0 
2.10.4 Example. Let V = R? and let B = {(1,0,1), (1,2,1), (0,0,9) 


. B. 
: í V* dual to the basis 
V. Let us try to find a basis for the dual space e wh 


Let (x y Z € f 3 r i alars Cy 
) R Since B is a basis Oo R , the e exist sc 
, , . 


Hl 
that (x, y, z) = C1 (1,0,1) + C2 (1,2,1) F C3 (0,0 ) 


= (c1 + Cz, 2C2, C1 + C2 + c3) 
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= Z. 
C 
2C: =y, gtit $ 
cy F *%) Z 


re 
Aas g Therefore, 
3 


0,0,1) 
Y (4,2,1) + (z — *)C0, 
Y (1,0,1) +54 
2(x-3) 2 


fa} of B-is given By 


poyani n 


ace over a f 
-ite dimensional vector SP 
be a finite dime wi aes i 
rad sisB = (24, Xz+ Xn? = 7 ai have, 
y* dual to B. Then for any f , 


f= Ş pease 
i=l 


n and B* generatesV’", let 


ield F with 


n} be the 
jo, 5/fheorem. L 


the ordered ba 
ordered basis for 


2 


proof, Since f (xi) € F for i = 4.250 


g= SDN 
i=l 


Now, for 1 < k < n, we have, 


gx) = Y FODE 
fai 


ESOV + FOr) fate) + + F Cred fie Gee) + + F Onn Ck) 
=f las fi(x,) =Oforitk, i.) = 1] 
Thus, g(x) = f (xx) for all basis vectors xp. 
letx € V, Then there exist scalars Cy,C2,..,C, such that 
X = yy ekt + Oe, 
Since, g is linear, we have, 


I) = ci g(x) + C29 (x2) + + Cng (Xn) 
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= Cif (x4) + c L (f) 
= cL ) + by 
= Fa 4 sia ? “nl nlg ) flex + p” cf (x) + fy == Q 
1 k) = z 
i kiina E e a POD key, pz la” LA 
= FQ) mear' Bruny | et” 2 (cle 79 0) 
Therefore, g — sity” p(x) * si 
hu en 
‘ pistine®” ) is the zero functional on V" for x el 
f= » all n p(x) = 

2.41 T G h a aq re KOry, THE the lemma, we have, = ý 

HE DOUBLE DUAL site " anpii 

10 
In the last sect; ker = {0} 
ection we h rrerefor® 

Space V iE ave s ne enë: OE E 

, there IS an Ordered ote ee for a given ordered so, pis one-one P sarad and dim y= dimV* = dim yH 

i asi | ý 


‘Is every o 
rdered basi dual of SB f 
S for V* j of B. But Ora 
answer to this problem in IS dual of this leads tte Vetta, | Cle 


; V ~ ve B 
7 ome ord : Qa ic an isomor 
this section. ered basis for yy " Problem | pence, Wis an ls 


phism. In other words, 


i *, Then 
sional vector space with dual space y". Th 


ry: Let V be a finite dimen basis forV. 


Let us consid 
erth 
e dual space of y* y“ is the dual basis for some 


as p= P corolla 


Each vector ordered basis for ists a dual basis 
x every - re exists a dua 
defined b EV induces a linear functi fy wes fn} be an ordered basis for V*. Then the 7 
¥ netional Ly on y*| proof. Let {fis J2 Jn By = be (fh) = fo for all i and J. Thus, 
Me Ly Vt py (ly A E in Vi, that is, Ôj = bx Vj) Joer 
1! n : 
LQ) = f(x), Vf Ev (fafa i fa) is the dual basis of {x1, X2; wan Mahe 
We first show that Ly is linear. In f | 111.2 Definition. The vector space y** is called the double dual of V. 
In A ae 
Li(cf + 9) = (cf + 9) act for fig € V* and forc € F,wehave, | 242 TRANSPOSE OF A LINEAR TRANSFORMATION AND ITS MATRIX IN THE 
2 I ' 
) = (PE) + 9@) | ias 
=c f(x) + g(x) = cha lF)+ t | Let us consider two finite dimensional vector spaces V and W over the same 


field F and a linear transformation T from V into W. Suppose g : W >F be 
ne | linear, that is, g is a linear functional on W, and let f (v) = g(T(v))for each v in 
. heorem. Let V be a finite dimensional vector | V. Thus, f = gT, thatis, f : V > F, a function, is the composition of T (T : V > 
v™ by W(x) = Ly. Spey AN Celine Weise W) with g (g :W > F). Since g, T both are linear and composition of two linear 

Then W% is an isomorphism. In other words, V is EE | bes is also linear, we see that f is also linear. Hence, f is a linear functional 

: : on V. If we write f = T'gthen we have, T! = 

, ; gv) = g(T)) for all v € V. Thus 
T l f 
induces a mapping T! from W*(as g € W*) into V* (as Ttg =f EV"). We 


Thus, bs ev. 


Proof. To prove this theorem, we prove this lemma first. 


er be a finite dimensional vector space, and let x € V. If L (f) = 0 | "ow show that, T is linear. In fact, for g1, gz € W* and for c € F 

, then x = 0. i 
[Tt (c + vp) = 

Proof of Lemma : Let x + 0. We show that there exists f € V* such thatl, (/) * 91 + gi) = (eon + T) 


0. Let us choose an ordered basis B = {x4, x2, ..., Xn} for V such thatxı =x le | 
{fi f2» =- fa} be the dual basis of B. Then fi (x1) = 1. 


So, fı (x) = 1° # 0 (as x = x4). Thus, f = f, serves our purpose. Thus, * = 


n 
Proof of the theorem : We first show that y is linear. Let x,y E V and c EF. T° 
for f € V*, we have, 


= cgi(T(v)) + g2(T(v)) 
= c(T'g1)(v) + (Ttg) (V) 


= (cT* g1 + g2)(v) 
91 +g) = cT'g, + on 


0. 


| Thus, T- 
| 
| 
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So, TT is linear. 
We shall call Tt 

Dual) of T. 


2.12.1 Properties : 
ü) of =9 
(ii) voy 
(ii) (4+ B) = ata pe 
(iv) (AB)? = Brat 
M GY = (aya 


Proof. Let y and W 
and let V"and W 


the tra 
Nspose of T. Some authors Prefer to call 
a it adia: 
Joint 


be two finite dimensional vector spaces over the same fj | 
“be the dual SpacesV meee 


and W respectively, 
O EO) = g(0Œ) 
v E€ ¥V.So, 0 = 0. 
(fi) Exercise. 
(iff) Let A,B:V > W be two linear ma 


(4 + B)@) = A(v) + B(v)is also line 
are linear maps from W* 


) = 9(0) =0= Oat); for all g ew: and for al 


Ps. Then A+B:y >W defined by | 


ar. Hence, A‘, Bt (A + B)', At + Bt af 
into V*. For any g E W* and foranyvey | 
(A + B)'(g)(v) = g[(A + B)\(v) | 


= g[(A+B)W)] 
= g| A(v) + B(v)] 
= g(A)(v) + g(B)(v) [as g is linear] 
= A'(g)(v) + B'(g)(v) 
= (AS + BY(g}(v) 
Hence, (A + B) = At +B!. 
iv) Clearly, | ee 
i (AB) (g)(v) = g(AB)(v) = (gA)(B)() j B! (gA)(v) = B'A (g 
Thus, (AB)* = BtA!. f B 
(v) Since, A is invertible, we have, AAT! = ATHA = 
Using property (ii) and property (iv), we have, , 
(A71)tAt = Ak (A71)! =t =I. 


Thus, (AT): = (A). 


05 
Linear Algebra ll 1 


s over the field 


ace ‘be an 
ional vector SP tp 
finite dimensional | basis By ane  ecformation 
a w be : for with dua a linear tran p and 
m. Let V dered basis ens Let T be elative to B. 
the ean or “+t dual basi trix of Tr on 
j b th a a e 
i p Let B sis for W W! (ajj) Pe the m gi’, B°- Then bij J 
ed bas et A= (ay wero uP" 
Li me matrix of Tt relative 
fro be the 
\etB =( if) ; — (wi Wz Wm} 
Vz Vn) f Ji 
proof. Let p= {v1 fae a {g 92 wr Gm 
pr = (fla saloh P 
we have, = ic» I= 4,2, 00)7 
Ty) = >, "3 
k=1 
n 
= 12, „m 
T'(g;) = 2u - 
15 
Again, (Ttg) = gj (Tvi) 
m 
= 9j H auw) 
k=1 
` i ar] 
= > Ani Dj (Wr) Íg; line 
k=1 
m 
= Aki Ôjk 
k=1 y 


= aji [Six = 0 forj + k, bj E= 1] 
For any linear functional fonVv 


fa Si . 
i=l 


Taking f = T‘ g; and using the fact (T! g)(¥) = aji, we have, 


Sn = T'g = S Urea ols = X wifi 
i= 


i=1 t= 


Hence, by linear independence Of {fi fo... fa), we have by = Qı m 
14 


_ FBS, 
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Presentation of T¢ 
r pair. 


to the forme 


2 the Annihilator the field F 


of S, is defined as and S is a Subset ofy 


Pa ae f 


That is, S° is the set of 


Whether $ i 
F, weh 

(cf + g)(s) = cf diii 

Hence, f,ges 


-S0, S° is a subspace of Vt. 
the set consisting of zer 
is the zero subspace of ’*. 


2.12.4 Proposition . Let S,T be two subsets of a vector s 
(i) SST implies T° c 50. 

(ii) If W = L(S) then W° = 59. 

Proof (i) Let f e T° 


© vector only, then 50 = Vit 


Pace over a field F, Then 


- Now, s € Simpliess eT (as S S T). Thus, f(s) =0. 


Therefore, f(s) = 0 forall s E S. So, fes. 
Hence, T? c 59, 


(ii) Since, S S W, by (i), W? c 59, 


Let f € S” and let w E€ W. Then f(s) = 0 for all s € S. Now, w=DGsi 
where c; E F, s; E Svi. 
Thus, f (w) = Ecif (s:) = 0. Therefore, f e W°. 
Thus, S° S W°. 
Hence, W? = S°. 
Now, we shall try to prove an important theorem. A 


the field F, 
2.12.5 Theorem. Let V be a finite dimensional vector space over 


let W be a subspace of V. Then 

dim W + dim W° = dim V. im 
Proof. Let dim V =n and dim W = k. Let {v1, z $ 
the basis {v1 V2.. Vr} for 


Let 
vg} be a basis for W. 
i the basis for 
us extend 


1 
Linear Algebra !l 
is for V 
he basis 
pafe fesse vod Pe" 
ket {fize 
Vn} 
lige nihilator W 
2 {vi this basis BS a basis for thean 
Py «qu {fi R E IS 
pich 1 that Uk+) a 
wes hes ( fit 
=6 ifi=J 
cleat") fly) ' aM 


jn }and jE 2a ki 


ss Ck" 
C2) coos 
d e scalars C1, 
"e pr 4em t” + c,V, for som 
ew, then w = 6401 &2 i 
ee we have, 
rie tk tk +4 att; _ D 
“ fiw) = cfi) + cofi(v2) + 
i 
i 2. eg 
a ee in W°, it is enough to show that 
“m fi fad is independent in i 
Since (f+) k42: un 
(fiat fiz fy} spans W. 


Let f E€ y*. Now, 


f= S roof 
i=1 


Now, iff E WP, then f(v) = f(v2) = = f(v) = 0, so 
f= food 


a. , 
Hence, f € LU feat, fk42s 1 fa}. In other words, W? = Li fka: frazs e fad 
‘ o = 
Thus, (fei fk4+2s =s fn} is a basis for W°. Therefore, dim W°? = n — k. Thus, 
k + (n-k) =n => dim W + dim W°’ = dim V m 
Oo. 

Corollary : If $ is any subset of a finite dimensional vector space V, then (8°) is 
the subspace spanned by S. 
p 

root, Let W = L(S): Then by Proposition 2.12.4, we have, W® = S°, 
‘9, itis enough to Proof, °° = w% — w, 
By the theorem, dimW + d 


7 imW°® = dimv. 
| 4S, dim wo + dimw = dim y‘ = dimV. 
nother Words, dim W = dim Ww, 


ince Wi 
Sasu 
bspace of W°, we have, W = weo 
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2.12.6 Example. Let y = R?, S= {(1,2, =i (3,0,1)} 
Forany f € V*, we have, _ 


x,y,z) = 
Fz) ax + by + cz, a,b.cepr 
Now, f € 59 


if and only if (1,2, -1)=0 and f(3,0 1) 


= 0. Thus, 
fES?! <=> 4t2b-c=0 z 
3a +0b+c=0 
a d aF 
2 —4 —6 


<=> (a,b,c) = (s, —2s, =g3s) S EF 
Thus, f € S° ifand only if 


f(x,y, Z) = sx — 2sy — 3sz = s(x — 


: 2y -s 3z) = Sg(X,y,2z) 


Hence, f =Sg,sEF. 


Therefore, S° = L{g} and hence, dim S? = 1. 


Now, it is easy to see that S is linearly independent and if W = 


L(S) then Wis 
a subspace of V such that dim W = 2. 


Again, by proposition 2.12.4, dim W? = dim $? = 1. 
Hence, dim W + dim W? =2+1=3=dimV m 


2.12.7 Theorem. Let V and W be vector spaces over the same field F, and letT 
t . 

be a linear transformation from V into W. The null space of T° is the 
annihilator of the range of T. If V and W are finite dimensional, then 


(i) rank (T*) = rank (T) 
(ii) the range of T° is the annihilator of the null space of T. 
Proof. Let g E W“, then we have, 

(T'g)(v) = g(T(v)), WE. 
Now, g €nullT' <=> (T'g)(v) = g9(T(v)) =0,vwv EV 


<=> g E annihilator of the range T. 
Hence, the null space of T' is the annihilator of the range of T. 


s P where 
the field F 
Let V and W are two finite dimensional vector spaces Stine f 
dimV =nand dimW = m. Let us denote range of a linear 


and null space of f by Nr. 


A 


t 


() 


ti) 


en Y 
ret rank T =": Th 


mRlL=m-T. 
therefore, dim Ry = ™ 
So, by the first pa 


Therefore, 


Hence, rank (T!) = rank T. 


t E Rr — 
z! if v € Nr then T(v) = 0. 
a t i 
Therefore, f (v) = (T g)(v) 


rt of the theorem, 


Linear Algebr 


= dim Rr. Thus, We an 
dim Rr + dim R2 = dimW = ™- 


sim Ny = dim RE =m — T 


Tt: W* > y* is linear, we have, yan 
i * = dim W = 
dim Nrt + dim Rr:' = dim W 


dim Ry =m — (m-— r) =r. 


‘ = Tg. 
Then there exists g € W* such that f 


g(T(v)) = g0) = 0. 


0 
thus, f € Nf. Thatis, Ryt S N?. 


0 
infact, Ryt isa subspace of Nr. 


Now, dim Ny + dim NF = dim V =n 


gives dim Np = n — dim Nr. 


Again, 


dim Nr + dim Ry = dim V = n gives dim Ryt =dim Rr = n — dim Nr. 


a 


Hence, dim N? = dim Rye. 


Thus, N? = Ryt, that is, the range of TË equals the null space of T. 


Solved Examples : 


In R3, let vı = (1,0,1), v, = (0, 1,—2), v3 = (—1, —1, 0), 


all 109 


a) If f is a linear functional on R3 such that f@1) =1, f(v) = 
~1L,fWs3) = 3 and ifv = (a,b,c), find f(v). 

(b) Describe explicitly a linear functional f on R3 such that 
FM) = fw.) = Obut f(v) + 0. 


(c) Let f be any 1i 


Solution, (a) Since, 


We see that, ív, v2, 


1), show that f(v) + 0. 


0 1 


1 -2|+0 
—1 0 


v3} is a basis for R3. 


near functional such that f (v1) = f(v) = 0 and 
f(v3) + 0.ifv = (23 
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Let v= (a, b,c) € R3 


- Then there exist scalars p 


q,r Such that 
eS py, + IVa + Fu, 


PCLO, + (0,1, 
jo. 7 =—PFre 
Solving we get, 

iim... 
Now, we have, 


ie. (a, D, c) = 


, —2 sad 
Lep ne = )+r( 1 


®=1,0) 
b, p — 2q =c 


a-=-b-=-c and r = 


™ = 2b arm 


fW) = f(a, b,c) = Pf (v,) + af (v2) + 
=(2a-2b-c).1+(a—p 
= 40 = 7h = 3 


Let f(x,y,z) = x —2y—z. Then 


Tf(vs)L as fis linear] 


— c).(—1) + (a~2p-— c).3 
(b) 


Ff) = f,0,1) = 0, f(a) = £,1,-2) =0 


f(v3) = f(-1,-1,0) =1¢ 0. 


(c) lfu= (2,3,1), we have by (a) 


(2,33, =1) ==», = 3v; [ taking a =2.b=3,c= -1] 


Thus,f(2,3,—1) = —f(,)— 3f (v3) #0 as f(v,) = 0 but f(v) +0. 
2. 


v2 = (1, 1, 1), v3 = (2, 2, 0). Find the dual basis of B. 
Solution. Let (x, y, z) € C? and a,b,c be the scalars such that 
(x,y,z) = a(1,0,—1) + b(1,1,1) + c(2,2,0) 


= (a+b+2c,b+2c,-a+b) 


Thus, 
at+b+2c=x 
b+2c=y 
—a +b =g 
1 1, Therefore, 
=—--x+y- Z. 
=x—yb=x-y+z,c T 2 
Solving, @=x—Y, 


1 0) 
1 _1) (0h 
1) +(-3x47 2 
(x,y, Z) = (x y)( aaen 


i by 
$ LA if {fo fa f3) 


If B = {v4, V2, v3} be an ordered basis for C3 defined by v; = (1,0,-1), 
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1 
1 a 
= =i ty" 5" ‘ 
hy z) Z 


mall ae oe 
field. Let fi fz 

be positive integers and F beat 

1 and 7 


fine, ation 
let 1 n for a E F”, de -< 9 linear transform 
: jinear functional a : f m(@))- Show that T is a linea 
MACN eee ned 
r(a) = (fal 
from F” to F". 


Soluti e , 


) 
r(ca +B) = (facet + B), face + BD: wr fm (car + BY) M 
= (cf,(@) + fB) cha) + (AC a (a) + fin 
[as f;'s are linear] 


= (cfa), cf2(@), sia E Ca + (fi (8), f2(B) aA 


= (f(a), F(a), -fa (@)) + (AO) f2) -fa BY) 
=cT(a) + T(B) 


Hence, T is linear. 


4. Define fe(R*) by f(x,y) =2x+y and T: R? > R? byT(x, v= 
(3% + 29,2), 


(a) Compute T'(f) 


(b) Compute [T4 g that is, the matrix represented by TÉ with respect to 
the ordered basis B*, where 


and B* = {f}, 


P is the standard ordered basis for R2 
that T'(f,) 


f2} is the dual basis, by finding scalars a,b,c,d such 
= af; + cfz and T'(f,) = bf, + df. 
(c) Compute [T] g and ([T],)' 


Solution, (a)We have, for (x,y) € R2, 
Tt = 
Gy) = f(T (x, y))= f(8x + 2y, 
(b) let B = 
ie {(1,0), (0,1)} be the standard b 


and compare your results with (b). 


x) = 2(3x + 2y) +x = 7x + 4y. 
asis for R?, Thus, for (x, y) E RÈ, we 


(x,y) = x(1,0) + y(0,1), 
Therefore, fA, y) = 


= 


x and f(x,y) =y, Now, 


ROUp 3 
THI ORY X LINI 
‘Al 3 
; 5 È ALGEBRA 
UX, y) = 
y) AG, y) (3 
and ~ SAG (3) 
Y) + i ‘ 
a Baly O = 3x4 
uey) sef 
= r(x 
Mag ( ( :y)) = f(3x + 
» We have i iló m 
1(X, y) 
7 ii alx,y) | 
(c) Si y z Aii 
ince, HERNES (3x + 2y ) : | 
3 1X), We have 
So, oG 
R h 3 


(Erla): = be a) 
=|. . 
ence, We See that FF ge aa CET] J 
H A] < 4B) 


5. : = 
n ¥1 = (1, 0;~1,2) and V2 = (2,3,1,1) 
spanned by v, a T \419, 1,7) and let Wp 
ae nd v2. Which linear functionals f ; © the subspace y 
X1, X a 
are in th “bs : 21X3, X4) = Cixi + CX +C 
e annihilator of W ? 2 F C3X3 + C4x4 
Solution. Clearl 
2 Y, Vy and v, are linearly i 
; ind thar i 
multiple of other. Thus dimension of W = A a hiia 
Sa ae | ‘ 


If f € W? then we have, f(v) = 0, f (v2) = 0. Now, 
f(v) = 0 => cy = 3 + 2e = 0 => G = cy — 2c, 
f 2) = 0 => 2cy + Bez + c3 + c4 = 0 => 26 +30 = -4-4 | 
Thus, 2(c3 — 2c4) + 3c2 = —C3 — Cy => Cz = —C3 + C4. 
Hence, f € W” if and only if 
f (X1, X2, X3, X4) = (c3 — 2c4)xX1 + (—c3 + c4)X2 + C3X3 + C444 
where C3, c4 are arbitrary. 
6. Let W be the subspace of R which is spanned by the vectors 
Vy = €1 + 2e2 + 3, 
Vz = €2 + 3e3 + 3e4 + es, 
V3 = e1 + 4e2 + Ge3 + 4e4 + es 


‘ i l É i . 
where e;s are standard basis of R°. FindW . 
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tion y the Lea a : aunt n- — 
solu as, 10,0) oe 
w°, then f) = % fw) = % vs) 
ok functional f can be written a5 
“a i )= a% + €2%2 + €3%3 + 4x4 Y C5X5 
foe je0e? u L 2c, +03 = 0 
i foo = c, + 363 1 Se, tig” 


ig t 6C3 + AC + C5 = 0 


e 
1 m "a —=~ Cre Hence, w 
Aca — 3es C2 = 364 t iy. gy 
_o- oA = LG) 


h gives Cy 
v fe w? if and only if, 


„X3, X4 %5) 

f(X Xp X3 X475 . (90, + Ce)xa + C4X4 t C5%5 
= (—4cy — 3c5)%1 + (3c4 + 2c5)x2 — (264 + c5)X3 

cs are arbitrary. 


ie vector space of all 2 x 2 matrices 


7, Let V be th 
pa E 7) 


numbers, and let 

Let Whe the subspace of V consisting of all A such that AB = 0. Let f bea 
linear functional on V which is in the annihilator of W. Suppose that 
f() = 0 and f(C) = 3, where lis the 2 x 2 identity matrix and 


_(0 0 
0 17° 


here C4, 
" ' over the field of real 


C 

Find f (B). 

Solution. We know that it f is a linear functional on V and A = (an Ja E V then 
f(A) = aay, + bazz + cazı + daz) where a,b,c,d E R. 


(X Y 
ia ( a E W, then AB = 0 gives 


x y = 
G w (i ‘a = p ‘ 
=> 2x —y = 0, —22+w=0 => y = 2x,w = 2z 


Thus, AE W = x 2 
t => A= x r 0 
fay C al Now, f € W? => f(A) = 0. Therefore, 
= ax + 2] E T : 
IX + cz + 2dz = O,t.e.(a + 2b)x + (c+2d)z=0. vx,zER 
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=0 and ¢ +2 
Thus, f(A) = d= ie he 
aay, a es, e ETE 
Given that FC 22 2 
iec=? )=0 ie. ae Tas 
= Za, 0 3)=0 


MEAD Stapa P) =3 pe. 
1 — == me 
f (4 y = 2a + (~54) (—2) + c(—1) +( 


= 2(-3) + (—3) + ene 
=0 


i 
gehi 

1) +34 

Hence, f(B} = 0m 


8. Let W 
1 and W, be two subspaces of a finite dim 


V. Prove that (W, + W) =W? aw? 

2 

Solution. Let f € (W, + W2)°. Then f(w) 

Let w, E€ W}. Since, 
f(w,) = 0. So, f ew. 


Ensional vector Spate 


= 0 forallw € Wi +Wy, 
0 E€ W3. We have, 


Similarly, it can be shown that f E€ WP. Thus, f EW? nwe, 
Therefore, (W, + W2)? cw? n w9. 
Conversely, let g E WP NWS. 

Then g(w,) = 0, g(w2) = 0 for allw} E W}, wz € W3. 
Now, w E W; + W3. Then w = w; + w, where w, E Wi, w2 E Wp. 
Theng(w) = g(w; + w2) = g(w,) + g(w2)=0+0=0. 
Therefore, g E€ (W; + W2)’. 
So, W$ n WẸ c (W, + W2)°. 
Hence, (W, + W2)? = WP nw. 


; W is 
9. Suppose that W is a finite dimensional vector space and that T:V 7 


of T 
linear. Prove that N(T‘) = (R(T): where N(T*) is the null space 


and R(T) be the range of T. | 


ppo) = 0t 


4 


Solution. Let f € N(T*). Then T'(f) = 0. In other words, 
vy € V. Thus, 


Wy = Wy +O EW +W, Then | 


15 
Linear Algebra ie 
0 
cr)’ = RO) 
_ ow eV =7 ing 
sro) äi 
(R(T) 
nein” e eV 
efore s = 0 => g(T)) = iiai 
t = 
A in g(R => T (g) 
j which shows thata e N(T') 
É _= 
Thus, 0 c N(T') 
efor ( )) p p 
there” 
— T 
ce (wer) aly ` over the field F and let W be a 
Hence, So _ dimensional vector ee w, prove that there exists 4 
be a tin! ; functional on W, 
0 Let V is a linear hae WwW. 
fv. lf f = f(a) for eac 
subspace © V such that g(a) = in V 
ional g On : te] endent in V, 
gi sn a wy} be a basis for W. Since, B is me i 
x B= Wy fapt , yv, Vegg Vetere “n j 
pet oat to a basis B= (wy, Waren Whe pau k+ ern spat 
paw tion on a vector space Is uniquely deter ded to a linear 
since a linear functi anani basis can be extende 


0 


= = = a= kt1k + 2,--,0- 
hwo = Ford fori = 1,2,...k and h(v,) = 0 fort k+1,k 
A= 


xf such that 
let v € V. Then there exist scalars pi: Pz. ‘Pn 


-Pki Pete’ 
y = pyWy + p2W2 +e + PR Wk tpt FE Pa 
Since, his defined on B’, h defines a linear functional g on V by 

gW) = pyg (vy) + + Peg Qe) + Pear gerd t+ Png (Yn) 


let @ E W. Then there exist Cy,Cz,-..C, such that @ = ciwy erw teet 
C,W,. Thus, 


f(a) = ferw + eaw be + ewe) = Cif (wi) + eaf (w2) Foe + cpf (wk) 
= q g(w:) + czg(wa) +- + chg (We) 
= g(cywy + CgW2 ++ + CkWk) 
= g(a) 

Hence, f = gonW. 


11, 
let F be a subfield of the field of complex numbers and let V be any 
vector space over F, Suppose that f and gare linear functionals on V 
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functional ony r h defined b 
Solution If possib rove that either f — v) = f . as follows 
ible, let f Corga e Ooi ne fo fef? á 
Oa 9=0 S als 3 and define / 1 
we "dg * Von. te a lings ; tet =R ae 
agai %) = F(2v)g(2v) = tP EV. Then fi? “a 
Bain, h(2v) = = 4f(v) pawnye? 
= 2A) h is ti IM)Las f pE»? < for V for 
is linear] = 9 are ling war ind a basis for 
2F( ar] f) y*, and then f 
v)g(v). Th 3 fa} isa basis for Y » 
which 4f(v)g(v) = erefore, prove that fofr kdn 
shows that f(@)g(v) Ke = 2f(v)g(v) | which it is th dual bas!s- itt aiti W be the set of all vectors 
wea FOr all t ! ositive integer T 
Let B " — fe m EV. sree (A) A. ~ pai a 3 i F” such that X1 + X2 +. + Xn 0 r : i MFS 
5 Xp Qe P . Is o e 
i linear functiona 
Let B= that W° consists of all 
1={bEB: ) Prove 
f(b) = 0} andB; = (be | færar Xn) = cea ot ily identified with 
Then B = By UB B : g(b) = 0}. | p) show that the dual space w* of W can be naturally ide 
If B i | j the linear functionals f i iita] = c1%1 + C222 ie Oars 
š 1 © B3, then B = B A le a wbleh satisfy C4 Cp to on =O 
is not the ca 2 and it shows that g = 0 á i s 
se. g =Ù onB and henceon y wih | 5 Let S be a set, F a field, and V (S; F) the space of all functions from 


So, By Æ B2. Similarly, it can be said that B, £ By. 
Let us choose b, E B; — Bz and b; E Bz — By. 
Then f(b2) # 0 and g(b,) + 0. Then 
f (by + ba) g (br + bz) = [f (b1) + fr) Lg 1) + 9rd] 
= f (b1)g (b1) + f (br) 9 (b2) + f (b2)g bd + f (b2)g (ba) 
= f(b2)g(bi)L as f (b1) = 0 = g(b2)] #0 
which contradicts (A). 


hence, either f = Oorg = OonV. 


Exercise 
W be 
1. LetV bea finite dimensional vector space over the field F and a ji 
subspace of V. if f is a linear functional on W, prove ae y in th 
ea 


linear functional g on y such that g(v) = f(v) for 


subspace W. 
2. Let VY bea nonzero vector space, 
(i.e. W + y). Prove that there exi 


such that foo= 0 for all x € W. 


and let W be aP 


i jona 
sts a non-zero jinear functio 


roper subspace of V 


into F ; 
(f+ 9) = f(x) + 9@) 


(cf)(x) = Sf 
Let W be any n —dimensional subspace of V(S; F)- Show that there exist 


points Xu X2- %n in S and functions fa fountain W such that 
ndilo 
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fee recall the concept of eigenvalue and eigenvector of a linear operator. 


let T be a li 
- aan operata on a vector space V. A nonzero vector v € V is called 
alte dlean T if there exists a scalar A such that T (v) = Av. The scalar A i 
genvalue corresponding to the eigenvector v l rw 


letT be a lin 
; ear operator o : 7 
basis B, We defi n an n —dimensional : 
. We define th man vector space V with an 
pohnomial of A, the e characteristic polynomial f (t) of T to be the ch E 
B thatis, , the matrix representation of T with respect to th aana 
e ordered basis 
We oft ft) = det(A — tI 
tl), en denote the characteristic pol a 
polynomial of an operator T by det(T — 


€ equati = 
Matrix 4 ene) = 0 
as defined s known as ch isti T 
aber. aracteristic equati 
as eigenvalues = Ws roots of the A ae san if gee ae 
ae (8) = A hae ah f(t) = Oare 
I f = 0, , A is an eigenvalue of 
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near Operator r then 
Integer Pk the a 

Ber k for Which ( ý Bebra Itiplic; ‘ned bY 

A) plici 3 define 
2 Sa factor of of 2 ig pR? de + 4z) 
13.1 p sii the | le. ron x 
efinition t arRes bas 3 Exa perato ax + 3Y + 22» . Now, 
eigenvalue of T. De linear Operator op a} 24 y= (4x +Z, 0) (0,0,1)3 for 
In Ector Space y tet T(x y,Z , (a 0,0), (0,1, , 1) = (1,2,4) 
{vey, Ate, red basis tù- (0,0, is is 
c a o 
It is to be Noted that E; is th n corresponding t i a 0,0) = (4,2,1), A of T with respect t 
. e , . 
of all elgenvectors of T corr = Bul Space of 7 _ bin j Nvalue } | T representation 
see that a IS. a Subs €sponding to A together with EL is the Collen: o, the matrix r 
the maximun, e i V. The number of element ie F. itis a p r 4 0 1 
: OF linear| a bas "of iven 2 

the ei i Y Independent AA | 8 =|2 3 

Di Benvalue A is the dimension of E}. “envicin fT tongs i 4 0.4 

Imension of E} is called th i 
€ geometric multi | 
Now, we sha ultiplicity of 3 


ll prove that the 


: Beometri iplici : 
sisters multiplicity ey ric Multiplicity of A is always less equal t 


m is, of A is 

istic polyno ial of T, that IS, C 

ris | 

oy d 2 )- att =S= a) i 
2 3-C 


| and hence the characte 

0 

| i —th= at( 2, 
| f=det(A 


= i algebraic multiplic 
| i f r 1 
| So, the eigenvalues of T are À 5 and À 3 W th 


ding to 
; T correspon 
ively. Now, if E}, be the. eigenspace of 
| and 2 respectively. i i 
Mez then (0) 
nai T 2s 2 )G)=(0) 
j = E 2 3-5 
it can be extended to an ordered basisB = By = Nri = 9 ( 1 0 eae i 
~- Vn} for V. Let A be the matrix representation of T with respet 

to the ordered basis B. Thus, each v; 
corresponding to A and hence, 


(2 2 2)Q)=(9}f 


Thus, we get a system of linear equations 


pe LS geometric multiplicity of à < algebraic multiplicity of a 
Proof. Let us consider an ordered 


i l basis [vi v, “+ Vk} for E}. Since, {vi va vg 
IS an independent set in EX(S V), 
{V1,V>,..., Vk, 


(1<i<k) is an eigenvector of T 


_ (Al, B 
a= ( 0 A 
where B and C are square matrices. 


The characteristic polynomial of T is given by 


=x +z=0 
CESI B E TET OER 
PE ae det ( 0 ‘ C= a x —z=0 
= det((A — t)I;,) det(C — thx) | < ’ 
$ Solving, we get (» =¢ (2), c is a scalar. 
= 4- t)*g(t) 4 A 
e the 
i f fC), and henc i 
i i , (A—t)* is a factor o 
where g(t) isa polynomial. To A m > k. But dim E = k. Hence, : Hence, m f, | 
algebraic multiplicity of A is at ae ee 


S PAR ALGEp 
ine 
any sin ‘ 
Ble 
fis NOn-nujy Vect 
SIS for Ẹ OF is lin 
1 Early ing 
e Penda 
nee, dim a =] i € See th, f/i | 
1.4, ath 
Similar| mother w rds it l, 
Pins Taani ’ Beometric ulti i 
11s] 
x 
_ 4~ 
E,, = (>) ; 3 0 1 
That i fe 2 (5 0 | 
'S, the solution 0 4~3 >) ~{0 | 
Space of the syste ‘Z 0 
m 
X+ z= 0 | 
2x +2z = 0 | 
Solving x= x+z=0 
a — -7 . i 
system Taking z 


se t, we have, x= 


bitrary Value. Let ys take y 
=s, 


Therefore, 


E | 5 = 
As = FS] A 
empha) E) sesin 


0 1 
— , . Sin i i i 


Hence, dim Ez, = 2. In other words, geometric multiplicity of; is 2. 


2.14” DIAGONALIZABILITY 


S 
Pi - -. a - 
/ Recall that an n x n matrix A is similar to ann xn matrix B if there exists 
non-singular matrix P such that B = P~!AP or B = PAP. 


2.14.1 Definition. A square matrix Aof order n is diagonalizable if it is similar toz 
diagonal matrix of order n. 
Thus A = (aij | is diagonalizable if there exists a non-singular matrix P such 
that 


P-1AP = D = diag {Ay,Az, sAn} 
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zil 
uinea! alge?’ 
. and 
d = 
rix where OY 
mat to 
= (di) xn ği Í we try 
gr?” at rs Su ose, to 
42 diad 42 n my dear "E ba answer- awit C e 
j “te ay be aise a try to onalizabl w 
by aes ; question al matrix ? gtrices a B ive integ atri 
gut m iven n jsqu o siti 3 ingular m 
g al k for 5 5 
„olte O? prix (not A“ fo yists a NON 
ET pentis apeten there © 
gago" aliza 
ies aint late FAIS on 
nt Or tain l p, 
° exp pes N , 
gan „p = D = diag {21,22 : k), again, wes 
p sch that Pa e = diag (1442 
t peT? aye te 
s Da 
what 6 à 
hat A = PDP , 
2p-1 
= 1) = PD kp-1l 
z = (PDP )(PPP E es] = PD*P 
A p-1)[k tim 
Then, ppp-!)(PDP) (PD p-1, Thus 
k= ; , 
' = the last 
sale f p, except for the first P and 
since each rae ak ae a] po 
ince . E Aapa An)’ 
wapp” s p.diag (35,42 
sya to compute. . al be 
which is e25Y Li eee ie al ( How this P comes? will b 
= . ve = 
anes tet A= $ 6) 01 
discussed later). 


Figenvalues of A are 1,6. Hence, We have, 


-1)_(1 aie! 
pot FeO 9S DG Deb “es 


i itive i ower of A. Since, 
Thus, it is easy to find A® or A5? or any positive integral p 


detA + 0, A? exists. Therefore, putting k = —1, we have, 


5 
p Pea 

=i PaT- 1 > 
6 


Now, we are ready to face big questions? Which matrices are diagonalizable 


ord how can we diagonalize a given diagonalizable matrix ? But before that we 
need some preparedness. 


ig 


EORY 
LINEA 
2.14.27 Fiii 
heorem lf 4 
Polynomi 3 
al nxn(F 
Some]. I(t) Of Ais of t a vod 
Proof te bag j form f(t) ak 
- Sin hing : 
Ce Ais diagonalizable it K i zee 
PEAS Ds gins eRe "i 
7 seuss diag (h1, A, i Bonal Matrix p 
Th Singular matrix p d 
oa aai ch 
H REIES Atia 
us, det = i Di 
i Cl D) aa e ' 
ie 2) (F7 An). 
det(t/,, —-D)= det(tp-1p _ p>} 
AP) = det(P-l pp _ 
= det p>1 de ae 


t(tl, = A)detp = detit] A) 
oa is 


the theorem 2.14.2 


i ; may not be disti 
diagonalizable matri istinct 


+ th i (] 
x A could b at is, the 


€ in the form 
Ap) t 


A= (2 E)E Mn 


Then the characteristic polynomial f(t) of A is given by 


We ar aaa e 

f(t) = det(tl, — A) = det ( . wen 

Thus, f(t) cannot be expressed as a product of linear factors over R. Hence, 
by theorem 2.14.2 the given matrix A is not diagonalizable. 


f | jc 
But one more thing is to be mentioned here that if the es 
polynomial of a given square matrix have linear factors, it is not eae 
r t 

is diagonalizable, that is, converse of the theorem 2.14.2 is not true. FO 


let 
a=( 3) 


Then the characteristic polynomial f (t) of A is given by 
f) = t- 1)’. 


)ae? +1. 


J 
Linear algebra Il 
di gonal matrix 
1a 
is similar to some 
| apie then 4 
, diagon??? 
pow if i ° 
c Y), p 
= det yes 
~ p=(, = 
= hus, = g 
| e we have, cx1= d.T | 0 id sine ppn 
aa ts a non-singular matrix P 5 
here exis 
now, t 7 
- fee i i rtoa diagonal matrix. In other 
| 4 contradiction. Hence, A cannot be simila 
rich is 3 CO a 


hen a square matrix is diagonalizable. 


0 find Ww | 
Now, let us tryt . . . | | 

| Ann An matrix A over a field F IS diagonalizable | 
714.3Theorem. f and only f 


l de j 
t e 


f, let Abeann xn matrix over a fieldF. 


| Proo 7 
| A is similar to a diagonal matrixD = 


| let A be diagonalizable, that is, 
diag {dy dz, +4 dn}. 
So, there exists a non-singular matrix P = (py)... 
| is, AP= PD. 


such thatP~!AP = D, that 
n 


Then jth column vector of AP = the jth column vector of PD. Now, the jth 
column vector of AP is 


Pij 
A| P3 
Pnj 
Pij 
and that of PD ig dj k . Hence, 
Pnj 
Pij Pij 
A Paj =d; P2j 
Thus, We see th . a i 
enon te the jth column vector 


elgenvalue dj of A. of P is an eigenvector of A 
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: BRA 
hus ea 
*£2ch colum 
iti N vector j 
tis Clear that all th lag ENvecto, 
dependent Wectors thas; the i i 
, 4 NON. 
Ecto ‘ney 
; Conversely i rs PA arei 
Orrespondi aA i 4 
“ices NB to the respective © neatly indep 
IStINCt. Here “IBenvaluesa, Endent Rigen 
PO aE one n ral Of whi Vector 
Y Not 4 
e 
vij 
v = 


Pun vyj Vin 
P= Y21022 f Paj Van 
VaVy? Vaj Van 
Since, Vis Pas.. U, are linearly independen 
Let D 


Now, the jth column vector of Ap is Av; and that of p 


Since, Av; = Ay, 
Jth column vector of P 


Dis Avy. 
we see that the jth colum 


D for j = L2 Hence, 


n vector of AP equals the 
singular, we have, P-14p = D. 


AP = PD, Since, P is non. 


Thus, A is similar to a diagonal matrix D. Therefor 


é, A is diagonalizable, 
Hence the theorem. 


Corollary : If eigenvalues of a Square matrix A € M 


nxn(F) are all distinct then A 
is diagonalizable. 


Proof. We first show that eigenvectors corresponding to distinct eigenvalues of a 
square matrix A are linearly independent. 


j istinct eigenvalues 
Let X; and X, be two eigenvectors corresponding to two i 2 ‘ 
— = 242: 
A, and Az respectively. Then , we have, AX, = A,X, and 2 
Ay +d X, #0, X, #0 


Let c1X1 + c2X2 =0...(1) where c}, cz E F. Then 
=0..(2 
CyAX, + C2AXy = 0 i.e. cAyXy + c24% = 0... (2) 


uation (2), We 
If we multiply the equation (1) by Az and subtract a a we 
get, c,(Ay — Az)X;, = 0 which shows that cy = 0 as 41 # 42 
pt] 


y 


w 
i tors on V. Now, 
ing from @ ion of all linear opera 

inear mapping be the collection © 

V. Let L(V) 


: tor 
is a linear opera 
duce an idea of invariant anne i a erae iiie 

ene ie T:V >V is line 

mensional vector space V (i.e.T : ¥ > € U => Tu € U. Clearly, the 
paaie n invariant subspace under T if j areire nE 
y of V is calle : } and the vector space itself are invarian oe 

eal ay e invarian 
te aa itis also clear that kerT and ImT ar 
linear ope 


=Q= T 
u € kerT => Tu = 0 => T (Tu) = T(0) = 0 => Tu E€ ker 
v E ImT => Tv E ImT. 


near operator On 
time has come to In 


and 


Although kerT and ImT are invariant subspaces under T ne T ay Fa 
be {Oy} or ImT could be V itself. We will try to face the problem beled 
non-trivial invariant subspace of dimension 1?’ How does an operator ehave 
an invariant subspace of dimension 1? Subspaces of V of dimension 1 are easy to 


describe. Take any nonzero vector u € V and let U equal the set of all scalar 
multiples of u that is, 


U=f{cu:cEF} 


Then U 'saone-dimensionalsubspaceof V, andeve 


of V is of this form. If 


then subspace U 
eof V invariant under T, 
The Squation Ty = hu 


whic j 
A We have just seen is intima 
NSP2CESimportantenoughtr, 


d 
fimesionalsubspac 


tely connected with One-dimensional 
atthevectorsuandscalars À satisfying it 
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are given ined 
Pecial na P p) is defin l 
Off e Li é es, Specifically, a scala perator P T)! Apah Om m p F, 
require u to h ere exists a NONZero rA is ¢ then th 1+ } az j 273 + 5Z + 
equation, Ti © nonzero because with i "such that Ty. Ceen re! gja | defined by pl 
uhieite © INUS we See that T has a é Scalar J Te, We i ic the poly 
YT has an eigenvalue one-dimensional invari Wa thea amples sTM lying it to 
' lant Oya rex 3 4. ae yin 
Look the e ; Subs Pag ao fo \ = 21 are app 
uation Ty — 3.. e T) e we l ator 
T= 20) ai digs i = Au is equivalent to (p A kf we ` f the symbol P a for some fixed ope! 
À h , It is => 0 ee oi : 
T — Al is not invertiby Clear that 7 IS not inje O and we knoy re Ig a new UP z tt is easy tO $ + p(T) is linear . 
e (singula ) lective, that IS, the o ‘thay took | Li just element mF) to L(V) given by p e P(F), then Pq Is 
Su Perata, | s, not JY? om PU = tis, if p,q i 
Ppose T € L(V) andaep — ge function fr sh coefficients in F, tha 
Called an Cigenvect N eigenvalue of TAR rel) mials with co 
to. (T <3 °F OFT (corresponding to ANITA 4g oe OTL ep ad gare POV by 
tod Ju = 0, we see that the set of einen.” Wiley | rr yr ne (pq) (2) = p(z)q(@) 
0A together with zero vector equals ker GENvectors Cnt f hep 
elgenvectors of T c ( In 


have, 
her with ic Sof similarly, WE = p(T)q(T) 
alue A there exists a no Tull vector, is a gy nz €F (pq)(T) =1 


we Can say that T — ans US Qu t 
O-butts Othe, 4 i y that T — A1 is not injective as we kno ea prali T € L(V). 
Sit ante the a eigenvalue of T if and Only if T - 7 IS Singular that; i ley- Hamilton Theorem 
TAE IS not invertible and this ha se ns ai yer 
injective. Ppens if and Only if T- 


|} mpya ix. Let 
er | ia Abe ann x n square matrix. 
e 


+t isti ial of A. 
yl cobe the characteristic polynomial 

1 g CEE 

aps is that operators can be rais 


f(x) = Cnt" + Cn-1% 
ed to powers. 


Since an operator T on V is a linear ma 
T(v) EV. Then we get T(T(v)) ev, T 
write T? 
by 


Then CA" + W. a ++ Coln = 9 
n 
p from V to V, for any v EV, we have, 


(r(r@))) E V and so on. We prefer to 
instead of TT and in general, for a positiv 


- A 
Thus, A satisfies its characteristic equatio 


proof, We know that for any square matrix P, 
P adjP = det P 1. 
Applying this result to the matrixA — xI, we get 


(A-xl)adj (A — x1) = det(A — xDI = XAQQI o e (1) 


e integer m, we can define T™ 


T™ = TT ....T (m times). 


For convenience, we define, T° to be the identity operator / on V. 


; ; i determinants (up to sign) 
If T is an invertible operator, then inverse of T is denoted by T~, Fora Now, adj (A — xI) is a iii whose entries j (A — xT) is a matrix whose 
itive integer m, we define T~” to be ys of(n-1) square submatrices of A — xI. Hence adj 
oe S Rhee ; fT i rator. then entries are polynomials in x of degree at mostn — 1. Thus, 
One can easily verify that if T is an operator, ee cen ree ea B, 
T™T™ =T™+ and (T™)" =T™ i n=l om 
ons Where Bi(i = 0,1, . 
e iva i rs if T is l Iži 
where m,n are integers if T is invertible and m,n are nonnegative intege canbe written as 
not invertible. 


Now, if p E P(F) is a polynomial given by 


=n — 1) are matrices with real entries. Hence, equation (1) 


(A= xI) (Baxti + By px? 4 vee Bix + Bo) 
= (Ap X" + ayy x") 4 4 ax + ag) 
p(z) = ag t+ayzZ+ Qyz? Feat Amz” 


= R + la E T h (a,l)x + agl 
forz EF. 
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Comparing the coeffi 


Iclents of lik , 
© Powers 
á set 


n=l = Ayl 
AB — 
n-1 Ba anıl 
AB, 5 = Bn > aa 
-2 
Mul i wa 
ee Uplying the first Of these e ea 
ut one by A and Sere ah 


, and addin m 
anA’ 4 An-1 E them we get 50 On, th 
Which ele 
completes the proof. 1 agl =0 
2.16.2 Cayle i 
$ Y-Hamilton Th 
Let T beal werent for Linear Operator 
in@ar operator On a fini i 
field F : inite dimensional ve 
Ai PA ah f (œ) as its characteristic polynomial Wien parce V Overa 
ransformation. That is, T Satisfies its characteristj = 0,0 being 
Proof. Let B be an orde eration 


i red basis for y. Let A b 
with respect to the order aii 
fŒ) = det(A — X). 


f(A) =0. 
By the isomorphism between L(V) and Man 


Solved examples: 


1. Let V be ann 


By theorem 2.16.1, 


xn (F), we get f(T =0. 


—dimensional vector space over a field F. What is the 
characteristic polynomial of the identity operator on ? What is ths 
characteristic polynomial for the zero Operator ? 
Solution. The identity operator on V can be represented by the n xn identity 
matrix/,,. Thus the characteristic polynomial of the identity operator is given by 
det(xJ,, —1,) = (x — 1)”. 

5 i its 
The zero operator on V can be represented by n xn zero matrix 0„. Thus í 
characteristic polynornial is given by 
det(xI,, —0,) = x". 


ix wi e property 
2. Prove that 1 is an eigenvalue of every square matrix with the p 
that the sum of the entries in each row equals 1. sina lee 
Solution. Let A be ann x n matrix such that the sum of the entries 
a 
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Let 
base PG op 
— 1, forl 7 Aale 
n_, aij ~ 
> =1 
where J 
- (aij) nxn 
us Ê 1 
1 
v = eee 
1/7 nxt E 
; have, 
._sion rule, WE 
ix multiplication °°” 1 
atrix ; s 
qnen by ™ Èj=1 aij 1 = v. 
Dyas 2f Se 
AV = ore 1 nx1 


j=1 Anj nx1 


san eigenvalue of A. 


i R such 
_ y shows that 11 pose a,b © 


L . Sup . I 
us, AV = or space and Teran igenvalue if and only 
á y is a real vect hat T has a real eig 
suppose = 0. Prove tha 
3. 24aT +b! ; 
en à e R. Then there exists a 
ifa? z 4b- genvalue 


rst suppose that T has an el 

Tv = Av. 

rv such that pee 
a =T(Av) = A(Tv) = Av) = 22v 


= => (42 +aà +b)v = 0 
thus, T’V anv =0 => 22v+aAav + bv = 0 => a+ 
@+er+ = 


solution- Let us fi 


non-zer 


24 aA +b = 0. For real value of A, we have, 
Since, v + 0, we have, À 


nv , 


Ay Az. Then 
aii 22 +a +b = (A — 21) — 22). 


Hence,0 = T? +aT + bI = (T — 241 1I)(T — 221) which shows na 
4N(T — Az!) is not injective. In other words, at least one of T — 141 andT — Az 


isnot injective. So, at least one of A, and Az must be an eigenvalue of T. Hence, T 
hasa real eigenvalue. 


4. Define Te £(C?) by T(w,z) = (z, 0). Find the set of eigenvectors of T. 
Solution, Let 4 be an eigenvalue of T. Then the eigenvalue-eigenvector equation 
15 given by 


T(w,z) = A(w,z) 


(z,0) = Aw, z). 
Thus, we have,z = aw and 0= dz. 


ie, 


RA 


, en 
Z 0 and hence w 0 that i 
Æ , IS, (w z) ( 
, 0,0). 


Since an ej 
elgenvalue m 
A must be dere, thätis 6 sable a non-zero eigeny 
š e 
must be zero but w can take tdi ates A aa we MAY cone 
a . (0) r 

T and the set of eigenv ny arbitrary value. Thus, 0 j T. Now, if A = Oth 

Ectors corresponding to 0 i S, Ois the only eigenvalue 

is given by nvalue of 


{(w, 0) imet— {0}} 


Ude that 


5. Su 
l ppose N E L(V) is nilpotent. Prove th i 
Solution. Let m b T" at 0 is the only ei 
y e a positive integer such th i Benvalue of T, 
v E V. Thus, N is not injective. So, 0 is an ei at N™ = 0, that is,N™(y) =o 
is the only eigenvalue of N. igenvalue of N. We shall show that 
Let A be an eigenval 
ue of N. The i 
nanba n there exists a non-zero vector v E V such 
Therefore, N?) = N(N(v)) = N(Av) = AN(v) = 220. 
After repeated application of N on both sides we have, 
N” (v) =A™v 
=>Q=A1"v => 2=0(asv #0). 


envalue of N. 


Hence, 0 is the only eig | 
6. Let T bea linear operator on R3 which is represented in the standard 
ordered basis by the matrix 
-9 44 
-8 3 4 
—16 8 7 ro 
xhibiting 4 basis for p3, each vect® 


diagonalizable by e 


Prove that T is 
teristic vector of T. 


which is a charac 


Solution. Let 


46 8 7 
by 
| of Ais given 
teristic polyne™ F 
Thus the charac et(xIn ) 4 
[ impli! 
(x+ yu- 
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he eigenvalues of A are given by 4, = -1, Az = 3: 


Thus t 
For Ay = —1, we have, 
(l — A)X = 0 


16 -8 
gx — 4y — 4z = 0 and 16x — 8y — 8z = 0 which gives 2x- y -Z= 


pio) v 


Z 


i.e. 
0. Hence, 


Thus, corresponding to the ei 
genvalue —1, we get two ei 
: o eigenvectors | 0 | and 
2 


Again, for the ei 
, genvalue A; = 3, the . 
, equation (A31 — A)X . 
= 0 gives 


TE 


This gives 
12x Ay — 4 
4y 42 = 0, 8x -—4z=0 16x g 
á —= oy = 4z = 0 . 
which 


gives 


Sin 
i 'Benvalue 3 is given by (2) 
2 
: 0 4 
| s 1 i909 
ies, =l 3 
nean ) : 
ence 4 2) neh) are i 
= nearly į 
` Y independ 
ent. 


ni ET 
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7. Let 
A and B be n X n matrices over the field F. Prove that if I — Ag i 
S 


invertible, then J — BA is invertible and 
(I — BA)™! = I + BU — AB)™'A. 


Solution. We have, 


(I — BA)[I + BUI — AB)~+A] 
=]+B(I1—AB)'A—BA- BAB(I — AB)714 


= I + B[(I — AB)! — I — AB(I — AB)™}]A 
= $48 [AB] "= 45) — 4 
=/+BU-DA =! 

Hence, (I— BA)! = I + BCI — 4B) 1A. 


1. Considera2 x2 matrix of real numbers 


fa: BY 
a= ie ia 
Prove that A has an eigenvalue in Rif and only if (a — d)? + 4bc > 0. 
2. Let 


6 -3 -2 
A= (4 —1 -2 
10 -5 -3 


Is A diagonalizable over the field R ? 


3. LetT be the linear operator on R4 which is represented in the standard 


ordered basis by the matrix 


0 0 00 
_{ a oO 00 
A=| o b 00 
0 0 c O 


4. Let T be a linear operator on the n —dimensional vector spaceV, and 
suppose that T has n distinct eigenvalues. Prove that T is diagonalizable. 
2.17 THE MINIMAL POLYNOMIAL OF A LINEAR OPERATOR 
First of all let us try to understand monic polynomial. 
2.17.1 Definition. A monic polynomial is a polynomial whose highest degree 


coefficient is 1. 
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gat art 3 is a monic polynomial but 2z3 + z + 1 is not. 


space over a field Fwith dimV = n. Let L(V) be the 
perators on V. Therefore, dim L(V) = n?. Then the aot 


paining. EETA N T 


ependent as S contains n* +1 elements (remember, a 
‘ 


mple, 
a vector 


“ i i in a vector space with dimensi 2 
cann independent set in £3 semen (omenber, a 
neat 
i | sents): itive integer such that 
si be the smallest posi 
m CE TF cet OY 


ependent. since this set is linearly dependent, we know that one of the 
above is a linear combination of the previous ones. Because 

opera sen to be smallest positive integer such that the set given above is 
as cho we conclude that T™ is a linear combination of 


m ss endent, 
m-1_ So, there exist scalars Qo, A1 +++, Am—1 E F such that 


ag! + aT #427? +0 Gm—aT™! +T™ = 0. 
a1 + âm-1 EF above is unique because if there are 


aol + a,T + ast? + aie Te +T” =0 


and bol + Dat + yy s TE FT 8 
bn-1 E F, then after subtraction we get 


for Do, Divs? 
(ay — bo)! + (a — bi)T ++ + (@m—1 — bm-1)T™ =! = 0 


Linear independence of {1,T,T2,..,T™ 1} shows that a; =b; for i= 
0,1, +977 — i 

The polynomial p 
minimal polynomial of T. 


Itis the monic polynomial p € P(F) of smallest degree such thatp(T) = 0. 


For a matrixA E Myx,(F) , the minimal polynomialp(z) of A is the monic 
polynomial of least positive degree for which p(A) = 0, 0 being the null matrix. 
For example, the minimal polynomial of the identity operator I is z—1 and 


(z) = ao +a}Z + a22? ++ + Am-1Z™7! + zis called the 


the minimal polynomial of the operator on F2 whose matrix equals to E a is 
p(z) = 6 — 5z + z’ 


Now, let us try to remember division algorithm for polynomials, which states 


T that 
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Suppose f,g € P(F), that is, f and g be two polynomials, with g + 9 Th 
. Then 


there exist polynomials q,r € P(F) such that 
f =9q +1 whereO < degr < degg. ! 


f r=0 ie. if f= gq then we say that the polynomial g divides th 
e 


polynomial f. 


By Cayley-Hamilton theorem for linear operators, we know that, for a lin 
ear 


operator T defined on an n —dimensional vector space V, there is a polynomi 
f(x) of degree n , known as characteristic polynomial of T, such that f(T) = 9 
being the zero transformation. Therefore, the degree of the minimal polynomial 
of each operator on V has degree at most n, that is, dim V. Why? The next 
theorem will clarify it. 


2.17.2 Theorem. Let p(z) be the minimal polynomial of a linear operator T on A 
finite-dimensional vector space V. Then for any polynomial gë 
ifg(T) = 0, 0 being the zero transformation, then p(z) divides g(z). in 
particular, p(z) divides the characteristic polynomial of T. 

Proof. Let g(z) be a polynomial such that g(T) = 0, 0 being zero transformation 

Then, by the division algorithm, there exist polynomials q(z) and r (z) such that 


g(z) = q(z)p(z) + r2) 
where 0 < degr < degp. Since, g(T) = 0, we have, 
q(T)p(T) + r(T) = 0. 

Again, p(T) = 0 gives r(T) = 0. Since, degree of r(z) is less than the degree 
of p(z) and p(z) is the minimal polynomial of T, r(z) must be the zero 
polynomial. 

Thus, we have, g(z) = q(z)p(z) which shows that p(z) divides g(z). 

In particular, if we take g(z) asthe characteristic polynomial of T, then the last 
part is proved 
Now we describe the eigenvalues of an operator in terms of its minimal 
polynomial. 


2.17.3 Theorem. Let T be a linear operator defined on finite dimensional vector 
space V. Then the zeros of the minimal polynomial of T are precisely the 
eigenvalues of T. 


Proof. Let p(z) = ao + aZ + azz? +e + Am-12" 1 +z™be the minimal 
polynomial of T. 


First suppose that A € F is a zero of p. Then, we have, 


p(z) = (z-A)q) 
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a monic polynomial with coefficients in F. Now, p(T) = 0 gives 
0 = (T—ANq(T) 
= (T _ana(T)(v), vv EV- 
“ace, the degree of q is less than the degree of the minimal polynomial p, 
neo 0 being the zero transformation. In other words, there exists u € V 
T , 
ve that gOJo # O- 
5 Hence (T- ANg() ay = 9 shows that A is an eigenvalue of T. 
ence, 


where qis 


let A € F bean eigenvalue of T. Let v be a non-zero vector in V 
Av. Then 


py = T(Tv) = T(4v) = AT (v) = A.Av = Ary 


continuing this process, we have, Tİ v = Av for each nonnegative integer j, 


co nve rsely, 
such that Ty = 


us, ae 
Th E = (ag + ay T + a2T? + + amiT T") 
= (dp + aA + a23? $e + AA") + A™)v 
= pA)v. 
pecause, V + 0, the equation above implies that p(A) = 0 which shows that 4 
is a zero of p(z) m 
Thus, it is clear that the characteristic polynomial and the minimal polynomial 
of a linear operator T on a finite dimensional vector space have the same zeros. 
gut do they have same number of zeros? The answer is negative. That is, if 4 € F 
be the eigenvalue of a linear operator T on a finite dimensional vector space V 
then A is a root of both characteristic equation and minimal polynomial equation 
of T. But if the multiplicity of 2 in minimal polynomial equation of T is m and the 
multiplicity of A in the characteristic equation of T isn thenm < n. 


2 —2 14 
A=!0 3 -7) 
0 0 2 


The characteristic polynomial of A, is given by 


Example. Let 


x—2 2 —14 
0 x-3 7 
0 0 x-2 


det(xI — A) = = (x — 2} (x — 3) 


Since, the minimal polynomial and characteristic polynomial of A have same 
zeros, the only possibilities for the minimal polynomials are (x — 2)(x — 3) or 
(x — 2)? (x — 3). Let us check now. 


A ee | a 
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0 -—2 14\/-1 -2 14 0 0 
(@-anc-ap =(t 1 -)( 0 r)=( T 
0 0 1/\0 oO ~1 0 0 of 
Hence, the minimal polynomial is (x — 2)(x — 3) = x? — 5x 4. 6. 


Let us consider another example. 


0 =4 85 
A=|1 4 -30) 
0 0 3 


Here the characteristic polynomial of A is given by 


x 4 —85 
-1 x-4 30 
0 0 x-3 


= (= 2)? @—3) 


Since, the minimal and characteristic polynomials have same zeros, th 
possible minimal polynomials are (x — 2)(x — 3) and (x — 2)?(x — 3). a 


-2 =4 85\/-3 -4 85 
Now, (A-—2I)(4 -3D =| 1 2 -30) ( 1 1 -30) 
0 0 1 0 0 0 
+ 0 [as (1,1)entry is non — zero] 


A = det(x/] — A) = 


= xix- 4)(@ = 3) + 4 ~ 3) 


So, (x—2)(x—3) cannot be the minimal polynomial of A. Hence, the 
minimal polynomial of A is given by (x — 2)? (x — 3). 


2.18 CANONICAL FORM 


We know that it is easy to deal with diagonalizable linear operators defined on 
a finite dimensional vector space V. But we should remember that all linear 
operators are not diagonalizable. Thus we need to consider alternative matrix 
representations for non-diagonalizable linear operators. These representations 
are called canonical forms. There are different kinds of canonical forms depending 
on their applications. Here we shall discuss two types of canonical forms, Jordan 
canonical form and the rational canonical form. 
The Jordan Canonical Form 


Let T be a linear operator on a finite dimensional vector space V, and suppose 
that the characteristic polynomial of T splits, that is, the characteristic polynomial 
f(z) of T can be written as in the form 

fE) = c2 — %1) — Az)... (Z — An) 
where å1,åÀ2,--,An are not necessarily distinct. If T is not diagonalizable, then 
there exists at least one A; whose geometric multiplicity is less than its algebraic 
multiplicity. 
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tudy the concept in matrix form. We know that a square matrix A is 

getter o ne matrix B if there exists a non-singular matrix P such 

gimilar to Aig if A is diagonalizable, then we get B as diag (Ay,Az,..,4,). But 

thath = P ; if A is not diagonalizable ? Definitely, we won't get a diagonal 

what aie to A but we will try to get nearly diagonal matrices. Now, we need 
atrix S| 


fine some concepts. 


to de jan block Ji 152 triangular matrix that has only one eigenvalue 1; and onty 
AJor an A 
iven below 
on eigenvector as È A 1 AD 
0 A; -0 
ss Cae | 
0 0. A; 


cipal diagonal is filled with some eigenvalue A; of the given matrix 
the diagonal next above the principal diagonal and all other entries 
ust a 1-by-1 block consisting of just some eigenvalue). 


where the prin 
A, entries 1on i 
are 0. (Ji may beJ ta 2 
31 X 1 Jordan Block is given by (A), a2 2 Jordan Block is given 


for example, sau 
is gi dso on. 
A 1) 3x3 order Jordan Block is given by{O A 1j]an 


rder n has s independent eigenvectors ( if A is not 


square matrix A of o EEO} 
ar e less than n, i.e. s < 7) then A is similar to a matrix 


diagonalizable then s must b 
n form) with s blocks as given below 


J (Jorda 
J, 0O ...0 
_{0 Jz «0 
I=) 20 
0 0. Js 


Where each J; is a Jordan block and each 0 is a zero matrix. 


For example, J = 


oooooc;onN 
CGCooocooonr 
GCOoOoOoCoONrFR © 
SOCONOCOCO 
aocoow coc a 6 O 
oowrRoaoco Oo 
oooo°cooc OO 

PFPoonooeooo do 


0 
Here, we see that the eigenvalues of J are 2 with algebraic multiplicity 4, 3with 
algebraic multiplicity 2 and O with algebraic multiplicity 2. In other words, the 
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oe polynomial of J is (x — 2)4(x — 3)2x2. It is clear from 

t at . . . . . i 

at the multiplicity of each eigenvalue is the number of times that the eige 
NValue 


appears on the diagonal of J. Also observe that only 1%, 4" 5* ang 7th 
represent the eigenvectors of A. columns 


: But how to find a Jordan Canonical form of a given square matrix 
near operator on a vector space? No matter, whether the matrix or th 
is diagonalizable. Before that we wish to state a theorem without proof. 


Or a given 
© Operator 
2.18.1 Theorem. Let A be ann x n matrix with characteristic polynomial 
C(x) = (x — A1) (x — AQ) R(X — Ap Rm 
and the minimal polynomial of A is given by 
m(x) = (x — 24)" (x —A,)2 ... (x — Am)'™ 


then A is similar to a matrix J in Jordan Canonical Form 


J, O0 ...0 
iO h ot 
J= ds i ..0 

0 0. Js 


where J1, J2,..,Js are all Jordan blocks. Furthermore, for each i 


(i) the sum of the sizes of the Jordan blocks with diagonal entries A; is 
equal to k;, that is, the algebraic multiplicity of A;. 

(ii) the largest Jordan block with diagonal entries A; is of order ti xt; 
where t; is the multiplicity of A; in the minimal polynomial m(x). 

(iii) the number of Jordan blocks with diagonal entries Ajis equal to 
geometric multiplicity of /;. 

Let us try to understand with an example. First of all | would like to clear two 
things. (1) Any square matrix can be brought into Jordan Canonical Form and (2) in 
the process characteristic polynomial and minimal polynomial of the given square 
matrix or of the given linear operator should be considered. 

Let the characteristic polynomial [c(x)] and minimal polynomial [m(x)] of a 
given linear operator or of its associated matrix be as given below: 

e(x) = (x — 5) (x — 3)4 
m(x) = œ — 5) G3)? 

Thus it is clear from c(x) that there are two eigenvalues, viz. 5 and 3 with 

algebraic multiplicity 3 and 4 respectively. We first consider the eigenvalue 5. 
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ere multiplicity of 5 is 2. Thus there exists a Jordan Block of 
ding to the eigenvalue 5 which is given below 


HEE a 


be other Jordan Blocks corresponding to 5 but their order should 


ook at m(x). H 


| 
ow, rrespon 


order 2 meee 


There might yal to 2, i.e. either it is 1 x 1 block or 2 X 2 block. Again, by (i) of 
pe less than or oe the sum of sizes of the Jordan Blocks should be equal to the 
the above MN of 5, in this case it is 3. Since, size of J4 is 2, other Jordan 
algebraic mu DE to 5 should be of size 1, that is, 
glock correspo h = (5) 

ider the eigenvalue 3. It is clear from c(x) that algebraic multiplicity 

Now, a the minimal polynomial m(x) ensures that there is Jordan Block of 

of 3 is 4- 4 


order 2 as given below p 


other Jordan Block corresponding to 3 will be less equal to 2. In J3, 
order of aes 2. But algebraic multiplicity of 3 is4. Hence, thera are two 
size a i e (i) a Jordan Block of size 2 corresponding to 3, as given below 
possibili les. 
3 1 

J4 = G 3 

i) there are two Jordan Blocks of size 1, viz. Js = (3) ana ig = S)- Which 
or ee will be considered, depends on the geometric multiplicity of 3 as the 
possi pata of Jordan Blocks corresponding to the eigenvalue 3 equals to its 
sees ie multiplicity. In this example, geometric multiplicity of an eigenvalle 
oe be determined as the square matrix or the linear operator is not given. 
anno ; 


a rdan Canonical Form J, is given by either 


Thus, the required Jo 


J, 0 0 O 
0 Jz O O 
J=\0 0 J3 0 
0 0 O f4 


Co0o0ce00on 
coco oOMmLH 
Seononado 
SCCOOWNDCSO 
SCOWKHKCCOO 
Owooocooo 
WereoocoocoooOoO 
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Or, 


cocooon 
cocdoOMm, 
oooounoo 
Ooowoocoo 
DOowmoocoo 
CWOD000 
WwWoocooooo 


2.19 RATIONAL CANONICAL FORM 


the given field F? For example, the characteristic polynomial of the matrix E 
M2,2(R), where A = i 


case, rational canonical form needed. But what is rational canonical form? To 
answer this we must have an idea of companion matrix as described below. 


IN- 5 
A is x? +1 which has no eigenvalue in R. In this 


Let us consider a monic polynomial m(x) as 
m(x) = ag + ax + Azk? 4 $ Qn yx"! pan 


Consider ann x n matrix Cm) as given below 


0 0 w= 0 -=a 
I O.a 0 —a, 
CGny=|/0 1 .. 0 a, 
O 0 ws 1 =e, 


is a matrix such that the entries of the last column of C(m) are filled by the 
coefficients of m(x) ( in increasing order of suffixes ) with a negative sign, 
1-1 diagonals are filled with 0 and entries below those n — 1 diagonals are 
filled with 1 and all other entries are filled by 0. Then the matrix C(m) is called 
the companion matrix of the monic polynomial l 


m(x) = ao + ax + dx? Heet 1 ME i +x” 
For example, if we consider the monic polynomial of degree 3 as 
m(x) = x3 + 3x2 — 8. 
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ao + a,x + azx? + x? we see that ay = ~8, a =0, Bei 
on matrix C (m) of m(x) is given by 


0 0 8 
a=(1 o 0 
0 1 =3 


me to define rational canonical form of a given square matrix 


comparing with 


ace, the compani 
pen 


Now, time has co 


A. ioned here that for any nxn matrix A over a field F, there are 

it is menti rmined monic polynomials qı), q2, 11 Or) such that 

yniquely ee lq) ++ Ira (x)ig-(x) and q,(x) is the minimal 
- i— 


polaz. the matrix A. If C;(q;) is the companion matrix of q(x) 

polynomial i then the rational canonical form of A is the matrix with the block 
;=1 2, on 

ci oe 


fo 
3 form š 
Cı (qı) 0 0 
0 Co(q2) © 0 
0 0 oon C- (qr). 


deliberately avoided any reference to the underlying vector space 
— yaa relationship to the C;’s and invariant subspaces so as to achieve 
andthe atte 


le description of the rational canonical form at least at the outset. 
asimple 


er the following things : 
TA elementary divisor q,(x) corresponding to C,(q,) is the minimal 
polynomial of A 7 
2, the product of the elementary wy dain 
characteristic polynomial C(x) of A, thatis, 
qi (Xx). p -qr x) = C(x) = det (xin —A) 
3. ifC(x) divides q,(x) then C(x) = q,(x), that is, in that case the 
characteristic polynomial of A and the minimal polynomial of A are the same. 


qi), i=1,2,...,r is the 


Let us try with an example. Let 


2 —2 14 
A= (0 3-7 
0 O 2 


The characteristic polynomial of A, is given by 


x—Z 2 —14 
0 x—-3 7 
(0) (0) x—2 


= (x — 2} (x — 3) 


det(xI — A) = 
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Since, the minimal polynomial and characte 
eros, e only possibilities for the minimal po 
(t-23 - 3). Let us check now. 


0 -2 14\/-1 -2 14 0 
a-nu -sn =( 1 =)( 0 r )=[o ; 
| ee ea me way 

Hence, the minimal polynomial is (x —2)(x = 3) =x? -5x +6. 


ristic polynomial of A ha 
lynomials are (x ~ 2)( 


Thus, the invariant factors are (x — 2)and (x — 2)(x — 3). 


Companion matrix for x — 2 is Cı = (2) 


~ and companion matrix for (x — 2)(x — 3) = x? e 5x +6 is 


aN e sea a i m 


@=( F) 


Hence, the rational canonical form of A is 


Let us consider another example. 


0 —4 85 
A=|1 4 -30) 
0 0 3 


Here the characteristic polynomial of A is given by 


—1 x-4 30 
0 0 x-3 


= x(x — 4) (x — 3) + 4(x - 3) 


A = det(xI — A) = 


x 4 —85 | 


= (x= 2)? —3) 


Since, the minimal and characteristic polynomials have same zeros, the 
possible minimal polynomials are (x — 2)(x — 3)and (x — 2)? (x — 3). 


-2 -4 85\/-3 -4 85 
Now, (A—2/)(A-3/) = (1 2 -2) 1 1 -30 
0 0 1/\0 0 0 


+0 [as (1,1)entry is non — zero] 


~~ 3) or 
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t be the minimal polynomial of A.’ Hence, the 


E anno 
(x- 2)(x 3) c by (x- 2)? (x — 3). Thus the only invariant 


sa ial of A is given 
_ «mal polynomia 
minim? 
factor IS A 
"E o i | 
anonical form of A, i.e. the companion matrix of 


Ag + (0-3) x8 — 7x? + 16x - 12, 


nce, the rational € 
T 


3 Let + 16% 12, is given by 

a 0 0 12 
(1 0 —16jE 
0 1 7 
samples: 

olved examp 7 

S d the minimal polynomial of the matrix A where A is given by 
4, Fin 


3 0 | 
2 
A= 2 2 
2 0 1 
solution. The characteristic polynomial of A is given by 
0 i 
x-3 0 1 
2 x-2 2 
zj 0 x-1 
= (x -3)(x —- 2x- 1) + x - 2) 
= (x -2D[(x-3)(«e-1) +1] 


= (x —2)3 


xI -A| = 


Since the minimal polynomial of A and the characteristic polynomial of A have 
same zeros, so possible forms of minimal polynomial of A are given by (x — 2) or 
(x — 2)or (x — 2). Let us check. 


Clearly, A — 2I #0. Now, 


1 0 1 1 0 1 000 
a-a =(2 0 | 2 0 2) = 0 0 0). 
—1 0 —1/ \-1 0 =f 000 


Hence, the minimal polynomial of A is given by (x — 2)?. 


2. Let a,b and c be elements of a field F, and let A be the following 3 x 3 
matrix over F : 
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Prove tha 
nat the characteristic polynomial for A Is x3 ~ x2 


that this Is also the minimal polynomial for A. ae. 


and 
So 
lution. The characteristic polynomial for A Is given by 


x 0 -C 

-1 x —) 

0 —1 x-a 
= x? = ax? = bx- c. 


|xI — Al = = x (x? — ax = b) +1(c) 


We first show that the minimal polynomial for A cannot be of degree 2 


Any monic polynomial of degree 2 can be written as f(x) = x? 


swhere r,s EF., Fre. 


Now, 


f(A) =A +rdAtsl 
00 c\? 00 c 100 
=|1 0 b sfa 0 i) s(t 1 | 
. 01a 01a 0 0 1 


0 c ac 0 0 re s 0 0 
=(0 b c+bal+ir 0 a + (0 5 o) 
1 a bt+a? 0 r ra 00 s 


S c ac+rc 
r bt+s c+ba+rb ) 
1 a+r b+a+ra+s 


Thus, f(A) + 0 for any 7s € F. Hence, monic polynomial for A cannot be of 
degree 2. Therefore, the minimal polynomial for A must be of degree 3. 


Since minimal polynomial for Adivides x? — ax? — bx — c, the characteristic 
polynomial for A, the minimal polynomial for A is given by x3 — ax? — bx- c. 
3. Finda 3 x 3 matrix for which the minimal polynomial is x. 


Solution. By the problem it is clear that any matrix A with A + 0 but A? =0 
serves our purpose. For example, 
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L(V) is invertible. prove that there exists a polynomialp € 

TE 

Su pose Oe os (T). 
i hatt” =P 7 B 

p(r)such ae P al? Sac r E 14 z" = Bas (1) 

Í | ial of T that is, this is the monic polynomial of smallest 

a , 


inimal polynom 
rm + T™ = 0 (2). 


T! ,weget, 


9, then multiplyin 


If do = ry"? r” =0 


gitat beet mnt 
monic polynomial 
92 +e + Am-12 


hat (1) is the minimal polynomial of T as 
e polynomial given by (1). Thus, ag + 0. 


refore, we Bet a 
TO a te 


h that q(T) = 0 which contradicts t 
suc 


degree of 7 is less than the degree of th 
e 


uence, by (2), WE get 
P. E ae -r bl 
ap ag ag 0 
; -1 
operating both sides by T~}, we get 
— ap ao ao ap 
A1 a2 anui Emal m-2 _}z7m-1 EP F 
il pua ~ Taw ap j ag ( ) 
we have, T7! = p(T). 
5, Give an example of an operator on C3 whose minimal polynomial equals 
2 
Z“, 


Solution. We wish to find an operatcr T € LCC?) such thatT2 = 0. 
letusdefineT: C33 C3 by T(2,22,23) = (Z3,0,0). 
Then for (21,29, 23) € C3, we have, T? (Z1, Z2, z3) = T(z3, 0,0) = (0, 0,0). 
Thus, T? = 0. 


If we take, q(z) =2z2, then we have, q(T) = T? = 0. Hence, minimal 
polynomial of T is a divisor of g. Now, the possible divisors of zare 1,z,z°. Let 
m(z) denote the minimal polynomial of T. . 
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Now, M(z) + Jas m(T) =1+ 0. 
If m(z) = z, then m(T) 
So, m(z) Cannot be z. 
Hence, m(z) = 22. 


=T+0. 


Th ` . . 
us, the minimal polynomial of T, as given above, is z2 


6. 
Suppose T € L(V)and v EV. Let p be the monic 
degree such thatp(T) 


polynomial of 
ofT v = 0. Prove that p divides t Smallest 


he minimal Polynomial 


Solution. Let m denote the minimal polynomial of T: B 


i divisi i 
exist polynomials q,r € P(F) such that YENSION algorithm there 


m=qp +r, Osdegr< deg p. 
Thus, m(T)v = q(T)p(T)v + r(T)v. 
But m(T) 


= Oand p(T)v = 0. Thus, we have, r(T)v = 0. 
Hence, 


r = 0( otherwise by a scalar multi 
monic polynomial r’, such that 
contradiction), 


l plication r can be transformed toa 
r (T)v = 0 and degr’ = degr < deg p which isa 
Therefore, m = qp. 

Thus, p divides the minimal polynomial of T. 


7. Find the Jordan Canonical form of the following matrix 


1 5 7 
a={0 4 3) 
0 0 1. 


Solution. The characteristic polynomial of A is given by 


A-1i -5 =7 
0 A-4 -3 
"0 0 A=1 


Thus, the eigenvalues of A are given by land 4. 


det(Alz = A) = 


= (A-1)?(A-4). 


Since the characteristic polynomial of A and the minimal polynomial of A have 
same zeros, the possible minimal polynomials of A are given by (A—1)(A- 
4)and (A — 1)? (å — 4). Now, 


0-5 -7\/3 -5 =7 000 
a—ayer—ay= (0 -3 -s)(c 0 =—3/+fO 0 0 
0 0 0/\0 0 3 000 


So, we can rule out the possibility (A — 1)(A — 4) as the minimal polynomial of 
A. Hence the minimal polynomial of A is given by (A — 1)? (4 — 4). 
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: Jordan block as given by 
exists a 2 X 2 
value 1, there 


thus, for eigen i n 
(0 1 
rresponding to 1 as the algebraic multiplicity 


co 
here is NO other Jordan block block corresponding to 4. Hence the Jordan 
and the 


is one 1X1 Jordan 


is 
is 7 There : ó 
-nical form of Ais given y 2% 9 
a (o E 
0 0 4 
ical form of 
: Jordan Canonica 
i — 200 1 0 
-lo 200 1 
s 00200 
00 0 2 0 
00001 
ion. The characteristic polynomial of A is given by 
lution. 
= detti — A) = 4-2 A-1): 
determinant of an upper triangular matrix is the product of its 
[ since Ge 
diagonals). 


the eigenvalues of A are given by 2 with algebraic multiplicity 4 and 1 

l ehes multiplicity 1. Since the minimal polynomial of A ang the 

ee aceon polynomial of A have same zeros, possible minimal polynomials of A 
charac 


are given below : 
m,(A) = (4-2) —- 1), 
m(A) = (A — 2)?(4— 1), 
m3(4) = 2-2} 4-1). 
m4(4) = (A— 2)*(A - 1). 


It is easy to show that (A —2/;)(A—/s) = Obut (A —2I5)*(A—Is) = 0. 
Thus the minimal polynomial of Ais (A — 2)? (2 — 1). Therefore, we can say that 
there exists a 2 x 2 Jordan block corresponding to the eigenvalue 2, given by 


ae | 
(9 2) 
and onel x 1 Jordan block corresponding to the eigenvalue 1. 


let E, = {X : AX = 2X}. 
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xy 
x 
let X= á 
Six 
x E E. Then, we have, 
Xs 
00 0 1 9 Xi 0 
0 0 0 0 1 x, 0 
00 9 0 0 
X3 |=] 0 |which gives x =0 = 
900 ollad |g eee 
00001 A 0 
x4 xy 1 
0 
Hence fiz z : . 
, 3 =|x =x 
a 2 1 ° + x2 ° +X ; » X4,X2,x3 ER, 
Xs 0 0 0 0 
Therefore, E, = L(S) where 
1 0 0 
0 1 0 
Sole lol O lel 4 
0 0 0 
0 0 0 


Since, S is linearly independent, S is a basis for E}. Hence, dimension of Ezis 
3, in other words, the geometric multiplicity of 2 is 3. Thus, there are three Jordan 


blocks corresponding to the eigenvalue 2, one is 2 x 2 and other two must be 
each of 1 x 1. 


Hence, the Jordan Canonical form of A is given by 


2 1000 

2 000 
0 0 2 0 OL 
000 2 0 
0 00 0 |! 


9. Find the rational canonical form of 


0 -1 -1 
a=(0 0 0 |. 
-1 0 0 
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: ic piven b 
haracteristic polynomial HEN RENEI 
echa 


ion. Th 
jution- 11 
5° B ” ” ol = x28 —x = x(x +1) —-1) 
detix-Y =|) o x 
istic polynomial of A have 
-~i of A and the characteris 
das olynomial fe) a a 
since the minimal P polynomial of A is given by x(x + 1) 1) 3 
ame zeros, the inoue: polynomial of A and it is the only invariant factor. 
2 ‘ chara ae 
which IS Gnr al canonical form of A is given by 
atl 


Hence, the f 


000 
(: 9 1) 
01 0 


rcise i 
oe sional vector space over a field F. What is the 


be a finite dimen i i : 
7 E» he polynomial for the identity operator on : 
mini 


Let A be the 4x 4 real matrix 


| 

l 
Nooo 
=- © O 


1 1 -1 0 


. ‘ 2 m 
show that the characteristic polynomial for A is x? (x — 1)? and it is 


also the minimal polynomial. 


3. Find the Jordan Canonical form of 


300a 2a 
Az|9 3 0 0 5 
o3 0 6 
6 003 060 
10 0 001 


4. Find the rational canonical form of 


c 0 =! 
a=(0 Ë at. 
—-1 1 c 


